W0511 19:39:13.644826 438207 site-packages/torch/distributed/run.py:793] 
W0511 19:39:13.644826 438207 site-packages/torch/distributed/run.py:793] *****************************************
W0511 19:39:13.644826 438207 site-packages/torch/distributed/run.py:793] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0511 19:39:13.644826 438207 site-packages/torch/distributed/run.py:793] *****************************************
[2025-05-11 19:39:24,751] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-11 19:39:24,841] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-11 19:39:24,865] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-11 19:39:24,870] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-11 19:39:24,870] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-11 19:39:24,880] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-11 19:39:24,881] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-11 19:39:27,266] [INFO] [comm.py:658:init_distributed] cdb=None
[2025-05-11 19:39:27,266] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
[2025-05-11 19:39:27,462] [INFO] [comm.py:658:init_distributed] cdb=None
[2025-05-11 19:39:27,480] [INFO] [comm.py:658:init_distributed] cdb=None
[2025-05-11 19:39:27,491] [INFO] [comm.py:658:init_distributed] cdb=None
[2025-05-11 19:39:27,619] [INFO] [comm.py:658:init_distributed] cdb=None
[2025-05-11 19:39:27,623] [INFO] [comm.py:658:init_distributed] cdb=None
[2025-05-11 19:39:27,906] [INFO] [comm.py:658:init_distributed] cdb=None
has image in dataset
using:  <class 'trainer.vllm_grpo_trainer_modified_math.Qwen2VLGRPOVLLMTrainerModified_math'>
You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
Flash Attention 2.0 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen2_5_VisionTransformerPretrainedModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `torch_dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", torch_dtype=torch.float16)`

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]has image in dataset
using:  <class 'trainer.vllm_grpo_trainer_modified_math.Qwen2VLGRPOVLLMTrainerModified_math'>
You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
Flash Attention 2.0 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen2_5_VisionTransformerPretrainedModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `torch_dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", torch_dtype=torch.float16)`

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]has image in dataset
using:  <class 'trainer.vllm_grpo_trainer_modified_math.Qwen2VLGRPOVLLMTrainerModified_math'>
has image in dataset
You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
using:  <class 'trainer.vllm_grpo_trainer_modified_math.Qwen2VLGRPOVLLMTrainerModified_math'>
Flash Attention 2.0 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen2_5_VisionTransformerPretrainedModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `torch_dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", torch_dtype=torch.float16)`
You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
Flash Attention 2.0 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen2_5_VisionTransformerPretrainedModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `torch_dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", torch_dtype=torch.float16)`
has image in dataset
using:  <class 'trainer.vllm_grpo_trainer_modified_math.Qwen2VLGRPOVLLMTrainerModified_math'>
You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
Flash Attention 2.0 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen2_5_VisionTransformerPretrainedModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `torch_dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", torch_dtype=torch.float16)`
has image in dataset
using:  <class 'trainer.vllm_grpo_trainer_modified_math.Qwen2VLGRPOVLLMTrainerModified_math'>
You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
Flash Attention 2.0 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen2_5_VisionTransformerPretrainedModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `torch_dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", torch_dtype=torch.float16)`
has image in dataset
using:  <class 'trainer.vllm_grpo_trainer_modified_math.Qwen2VLGRPOVLLMTrainerModified_math'>
You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
Flash Attention 2.0 only supports torch.float16 and torch.bfloat16 dtypes, but the current dype in Qwen2_5_VisionTransformerPretrainedModel is torch.float32. You should run training or inference using Automatic Mixed-Precision via the `with torch.autocast(device_type='torch_device'):` decorator, or load the model with the `torch_dtype` argument. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="flash_attention_2", torch_dtype=torch.float16)`

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:04<00:14,  4.68s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:04<00:14,  4.74s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:04<00:14,  4.88s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:04<00:14,  4.73s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:04<00:14,  4.75s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:04<00:14,  4.69s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:04<00:14,  4.74s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:08<00:08,  4.46s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:09<00:09,  4.52s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:09<00:08,  4.48s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:09<00:08,  4.50s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:09<00:09,  4.53s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:09<00:09,  4.52s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:09<00:09,  4.58s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:13<00:04,  4.32s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.16s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.63s/it]

Loading checkpoint shards:  75%|███████▌  | 3/4 [00:13<00:04,  4.36s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:13<00:04,  4.35s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:13<00:04,  4.34s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:13<00:04,  4.36s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:13<00:04,  4.34s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:13<00:04,  4.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.18s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.65s/it]

Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.18s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.66s/it]

Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.20s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.68s/it]

Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.20s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.22s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.67s/it]

Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.20s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.71s/it]

Loading checkpoint shards: 100%|██████████| 4/4 [00:14<00:00,  3.68s/it]
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
Detected kernel version 5.4.0, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
INFO 05-11 19:39:59 __init__.py:207] Automatically detected platform cuda.
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
vllm is running on:  cuda:7
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
[rank3]:[W511 19:40:00.990285204 ProcessGroupNCCL.cpp:4115] [PG ID 0 PG GUID 0 Rank 3]  using GPU 3 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.Specify device_ids in barrier() to force use of a particular device,or call init_process_group() with a device_id.
[rank5]:[W511 19:40:00.142093952 ProcessGroupNCCL.cpp:4115] [PG ID 0 PG GUID 0 Rank 5]  using GPU 5 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.Specify device_ids in barrier() to force use of a particular device,or call init_process_group() with a device_id.
[rank2]:[W511 19:40:00.180816133 ProcessGroupNCCL.cpp:4115] [PG ID 0 PG GUID 0 Rank 2]  using GPU 2 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.Specify device_ids in barrier() to force use of a particular device,or call init_process_group() with a device_id.
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
[rank4]:[W511 19:40:02.228199329 ProcessGroupNCCL.cpp:4115] [PG ID 0 PG GUID 0 Rank 4]  using GPU 4 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.Specify device_ids in barrier() to force use of a particular device,or call init_process_group() with a device_id.
[rank6]:[W511 19:40:02.268822039 ProcessGroupNCCL.cpp:4115] [PG ID 0 PG GUID 0 Rank 6]  using GPU 6 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.Specify device_ids in barrier() to force use of a particular device,or call init_process_group() with a device_id.
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
[rank1]:[W511 19:40:04.045297268 ProcessGroupNCCL.cpp:4115] [PG ID 0 PG GUID 0 Rank 1]  using GPU 1 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.Specify device_ids in barrier() to force use of a particular device,or call init_process_group() with a device_id.
INFO 05-11 19:40:07 config.py:549] This model supports multiple tasks: {'reward', 'embed', 'classify', 'score', 'generate'}. Defaulting to 'generate'.
WARNING 05-11 19:40:07 arg_utils.py:1131] --enable-prefix-caching is currently not supported for multimodal models in v0 and has been disabled.
WARNING 05-11 19:40:07 cuda.py:95] To see benefits of async output processing, enable CUDA graph. Since, enforce-eager is enabled, async output processor cannot be used
WARNING 05-11 19:40:07 config.py:685] Async output processing is not supported on the current platform type cuda.
INFO 05-11 19:40:07 llm_engine.py:234] Initializing a V0 LLM engine (v0.7.3) with config: model='/export3/huangdongchi/hdc_debug/model_res_7b/sft/Qwen2.5-VLmath', speculative_config=None, tokenizer='/export3/huangdongchi/hdc_debug/model_res_7b/sft/Qwen2.5-VLmath', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, override_neuron_config=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.bfloat16, max_seq_len=6144, download_dir=None, load_format=auto, tensor_parallel_size=1, pipeline_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=True, kv_cache_dtype=auto,  device_config=cuda:7, decoding_config=DecodingConfig(guided_decoding_backend='xgrammar'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), seed=0, served_model_name=/export3/huangdongchi/hdc_debug/model_res_7b/sft/Qwen2.5-VLmath, num_scheduler_steps=1, multi_step_stream_outputs=True, enable_prefix_caching=False, chunked_prefill_enabled=False, use_async_output_proc=False, disable_mm_preprocessor_cache=False, mm_processor_kwargs={'max_pixels': 501760, 'min_pixels': 3136}, pooler_config=None, compilation_config={"splitting_ops":[],"compile_sizes":[],"cudagraph_capture_sizes":[],"max_capture_size":0}, use_cached_outputs=False, 
INFO 05-11 19:40:08 cuda.py:229] Using Flash Attention backend.
[rank0]:[W511 19:40:08.897206853 ProcessGroupGloo.cpp:715] Warning: Unable to resolve hostname to a (local) address. Using the loopback address as fallback. Manually set the network interface to bind to with GLOO_SOCKET_IFNAME. (function operator())
INFO 05-11 19:40:08 model_runner.py:1110] Starting to load model /export3/huangdongchi/hdc_debug/model_res_7b/sft/Qwen2.5-VLmath...
INFO 05-11 19:40:08 config.py:3054] cudagraph sizes specified by model runner [] is overridden by config []

Loading safetensors checkpoint shards:   0% Completed | 0/4 [00:00<?, ?it/s]

Loading safetensors checkpoint shards:  25% Completed | 1/4 [00:00<00:00,  3.65it/s]

Loading safetensors checkpoint shards:  50% Completed | 2/4 [00:01<00:01,  1.66it/s]

Loading safetensors checkpoint shards:  75% Completed | 3/4 [00:02<00:00,  1.31it/s]

Loading safetensors checkpoint shards: 100% Completed | 4/4 [00:02<00:00,  1.22it/s]

Loading safetensors checkpoint shards: 100% Completed | 4/4 [00:02<00:00,  1.35it/s]

INFO 05-11 19:40:12 model_runner.py:1115] Loading model weights took 15.6270 GB
It looks like you are trying to rescale already rescaled images. If the input images have pixel values between 0 and 1, set `do_rescale=False` to avoid rescaling them again.
INFO 05-11 19:40:17 worker.py:267] Memory profiling takes 4.92 seconds
INFO 05-11 19:40:17 worker.py:267] the current vLLM instance can use total_gpu_memory (95.11GiB) x gpu_memory_utilization (0.90) = 85.60GiB
INFO 05-11 19:40:17 worker.py:267] model weights take 15.63GiB; non_torch_memory takes 0.13GiB; PyTorch activation peak memory takes 1.04GiB; the rest of the memory reserved for KV Cache is 68.80GiB.
INFO 05-11 19:40:17 executor_base.py:111] # cuda blocks: 80515, # CPU blocks: 4681
INFO 05-11 19:40:17 executor_base.py:116] Maximum concurrency for 6144 tokens per request: 209.67x
INFO 05-11 19:40:20 llm_engine.py:436] init engine (profile, create kv cache, warmup model) took 8.05 seconds
[rank0]:[W511 19:40:21.812107514 ProcessGroupNCCL.cpp:4115] [PG ID 0 PG GUID 0 Rank 0]  using GPU 0 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.Specify device_ids in barrier() to force use of a particular device,or call init_process_group() with a device_id.
[2025-05-11 19:40:29,656] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed info: version=0.16.4, git-hash=unknown, git-branch=unknown
[2025-05-11 19:40:29,656] [INFO] [config.py:734:__init__] Config mesh_device None world_size = 7
[2025-05-11 19:40:29,656] [INFO] [config.py:734:__init__] Config mesh_device None world_size = 7
[2025-05-11 19:40:29,656] [INFO] [config.py:734:__init__] Config mesh_device None world_size = 7
[2025-05-11 19:40:29,656] [INFO] [config.py:734:__init__] Config mesh_device None world_size = 7
[2025-05-11 19:40:29,656] [INFO] [config.py:734:__init__] Config mesh_device None world_size = 7
[2025-05-11 19:40:29,657] [INFO] [config.py:734:__init__] Config mesh_device None world_size = 7
[2025-05-11 19:40:29,657] [INFO] [config.py:734:__init__] Config mesh_device None world_size = 7
[2025-05-11 19:40:52,501] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Flops Profiler Enabled: False
[2025-05-11 19:40:52,503] [INFO] [logging.py:128:log_dist] [Rank 0] Creating BF16 optimizer
[2025-05-11 19:40:52,986] [INFO] [utils.py:781:see_memory_usage] begin bf16_optimizer
[2025-05-11 19:40:52,987] [INFO] [utils.py:782:see_memory_usage] MA 15.49 GB         Max_MA 15.49 GB         CA 15.69 GB         Max_CA 16 GB 
[2025-05-11 19:40:52,987] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory:  used = 292.19 GB, percent = 15.2%
[2025-05-11 19:40:53,440] [INFO] [utils.py:781:see_memory_usage] end bf16_ optimizer
[2025-05-11 19:40:53,441] [INFO] [utils.py:782:see_memory_usage] MA 15.49 GB         Max_MA 15.49 GB         CA 15.69 GB         Max_CA 16 GB 
[2025-05-11 19:40:53,441] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory:  used = 292.19 GB, percent = 15.2%
[2025-05-11 19:40:53,443] [INFO] [config.py:1001:print] DeepSpeedEngine configuration:
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   activation_checkpointing_config  {
    "partition_activations": false, 
    "contiguous_memory_optimization": false, 
    "cpu_checkpointing": false, 
    "number_checkpoints": null, 
    "synchronize_checkpoint_boundary": false, 
    "profile": false
}
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   aio_config ................... {'block_size': 1048576, 'queue_depth': 8, 'intra_op_parallelism': 1, 'single_submit': False, 'overlap_events': True, 'use_gds': False}
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   amp_enabled .................. False
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   amp_params ................... False
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   autotuning_config ............ {
    "enabled": false, 
    "start_step": null, 
    "end_step": null, 
    "metric_path": null, 
    "arg_mappings": null, 
    "metric": "throughput", 
    "model_info": null, 
    "results_dir": "autotuning_results", 
    "exps_dir": "autotuning_exps", 
    "overwrite": true, 
    "fast": true, 
    "start_profile_step": 3, 
    "end_profile_step": 5, 
    "tuner_type": "gridsearch", 
    "tuner_early_stopping": 5, 
    "tuner_num_trials": 50, 
    "model_info_path": null, 
    "mp_size": 1, 
    "max_train_batch_size": null, 
    "min_train_batch_size": 1, 
    "max_train_micro_batch_size_per_gpu": 1.024000e+03, 
    "min_train_micro_batch_size_per_gpu": 1, 
    "num_tuning_micro_batch_sizes": 3
}
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   bfloat16_enabled ............. True
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   bfloat16_immediate_grad_update  False
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   checkpoint_parallel_write_pipeline  False
[2025-05-11 19:40:53,444] [INFO] [config.py:1005:print]   checkpoint_tag_validation_enabled  True
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   checkpoint_tag_validation_fail  False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   comms_config ................. <deepspeed.comm.config.DeepSpeedCommsConfig object at 0x7f6a52284340>
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   communication_data_type ...... None
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   compression_config ........... {'weight_quantization': {'shared_parameters': {'enabled': False, 'quantizer_kernel': False, 'schedule_offset': 0, 'quantize_groups': 1, 'quantize_verbose': False, 'quantization_type': 'symmetric', 'quantize_weight_in_forward': False, 'rounding': 'nearest', 'fp16_mixed_quantize': False, 'quantize_change_ratio': 0.001}, 'different_groups': {}}, 'activation_quantization': {'shared_parameters': {'enabled': False, 'quantization_type': 'symmetric', 'range_calibration': 'dynamic', 'schedule_offset': 1000}, 'different_groups': {}}, 'sparse_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'row_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'head_pruning': {'shared_parameters': {'enabled': False, 'method': 'topk', 'schedule_offset': 1000}, 'different_groups': {}}, 'channel_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'layer_reduction': {'enabled': False}}
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   curriculum_enabled_legacy .... False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   curriculum_params_legacy ..... False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   data_efficiency_config ....... {'enabled': False, 'seed': 1234, 'data_sampling': {'enabled': False, 'num_epochs': 1000, 'num_workers': 0, 'curriculum_learning': {'enabled': False}}, 'data_routing': {'enabled': False, 'random_ltd': {'enabled': False, 'layer_token_lr_schedule': {'enabled': False}}}}
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   data_efficiency_enabled ...... False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   dataloader_drop_last ......... False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   disable_allgather ............ False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   dump_state ................... False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   dynamic_loss_scale_args ...... None
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_enabled ........... False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_gas_boundary_resolution  1
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_layer_name ........ bert.encoder.layer
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_layer_num ......... 0
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_max_iter .......... 100
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_stability ......... 1e-06
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_tol ............... 0.01
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   eigenvalue_verbose ........... False
[2025-05-11 19:40:53,445] [INFO] [config.py:1005:print]   elasticity_enabled ........... False
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   flops_profiler_config ........ {
    "enabled": false, 
    "recompute_fwd_factor": 0.0, 
    "profile_step": 1, 
    "module_depth": -1, 
    "top_modules": 1, 
    "detailed": true, 
    "output_file": null
}
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   fp16_auto_cast ............... None
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   fp16_enabled ................. False
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   fp16_master_weights_and_gradients  False
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   global_rank .................. 0
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   grad_accum_dtype ............. None
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   gradient_accumulation_steps .. 2
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   gradient_clipping ............ 1.0
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   gradient_predivide_factor .... 1.0
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   graph_harvesting ............. False
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   hybrid_engine ................ enabled=False max_out_tokens=512 inference_tp_size=1 release_inference_cache=False pin_parameters=True tp_gather_partition_size=8
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   initial_dynamic_scale ........ 1
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   load_universal_checkpoint .... False
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   loss_scale ................... 1.0
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   memory_breakdown ............. False
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   mics_hierarchial_params_gather  False
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   mics_shard_size .............. -1
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   monitor_config ............... tensorboard=TensorBoardConfig(enabled=False, output_path='', job_name='DeepSpeedJobName') comet=CometConfig(enabled=False, samples_log_interval=100, project=None, workspace=None, api_key=None, experiment_name=None, experiment_key=None, online=None, mode=None) wandb=WandbConfig(enabled=False, group=None, team=None, project='deepspeed') csv_monitor=CSVConfig(enabled=False, output_path='', job_name='DeepSpeedJobName')
[2025-05-11 19:40:53,446] [INFO] [config.py:1005:print]   nebula_config ................ {
    "enabled": false, 
    "persistent_storage_path": null, 
    "persistent_time_interval": 100, 
    "num_of_version_in_retention": 2, 
    "enable_nebula_load": true, 
    "load_path": null
}
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   optimizer_legacy_fusion ...... False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   optimizer_name ............... None
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   optimizer_params ............. None
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   pipeline ..................... {'stages': 'auto', 'partition': 'best', 'seed_layers': False, 'activation_checkpoint_interval': 0, 'pipe_partitioned': True, 'grad_partitioned': True}
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   pld_enabled .................. False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   pld_params ................... False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   prescale_gradients ........... False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   scheduler_name ............... None
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   scheduler_params ............. None
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   seq_parallel_communication_data_type  torch.float32
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   sparse_attention ............. None
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   sparse_gradients_enabled ..... False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   steps_per_print .............. inf
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   tensor_parallel_config ....... dtype=torch.float16 autotp_size=0 tensor_parallel=TPConfig(tp_size=1, tp_grain_size=1, mpu=None, tp_group=None) injection_policy_tuple=None keep_module_on_host=False replace_with_kernel_inject=False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   timers_config ................ enabled=True synchronized=True
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   train_batch_size ............. 14
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   train_micro_batch_size_per_gpu  1
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   use_data_before_expert_parallel_  False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   use_node_local_storage ....... False
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   wall_clock_breakdown ......... True
[2025-05-11 19:40:53,447] [INFO] [config.py:1005:print]   weight_quantization_config ... None
[2025-05-11 19:40:53,448] [INFO] [config.py:1005:print]   world_size ................... 7
[2025-05-11 19:40:53,448] [INFO] [config.py:1005:print]   zero_allow_untested_optimizer  False
[2025-05-11 19:40:53,448] [INFO] [config.py:1005:print]   zero_config .................. stage=0 contiguous_gradients=True reduce_scatter=True reduce_bucket_size=1000000000 use_multi_rank_bucket_allreduce=True allgather_partitions=True allgather_bucket_size=1000000000 overlap_comm=False load_from_fp32_weights=True elastic_checkpoint=False offload_param=None offload_optimizer=None sub_group_size=1000000000 cpu_offload_param=None cpu_offload_use_pin_memory=None cpu_offload=None prefetch_bucket_size=50000000 param_persistence_threshold=100000 model_persistence_threshold=9223372036854775807 max_live_parameters=1000000000 max_reuse_distance=1000000000 gather_16bit_weights_on_model_save=False module_granularity_threshold=0 use_all_reduce_for_fetch_params=False stage3_gather_fp16_weights_on_model_save=False ignore_unused_parameters=True legacy_stage1=False round_robin_gradients=False zero_hpz_partition_size=1 zero_quantized_weights=False zero_quantized_nontrainable_weights=False zero_quantized_gradients=False zeropp_loco_param=None mics_shard_size=-1 mics_hierarchical_params_gather=False memory_efficient_linear=True pipeline_loading_checkpoint=False override_module_apply=True log_trace_cache_warnings=False
[2025-05-11 19:40:53,448] [INFO] [config.py:1005:print]   zero_enabled ................. False
[2025-05-11 19:40:53,448] [INFO] [config.py:1005:print]   zero_force_ds_cpu_optimizer .. True
[2025-05-11 19:40:53,448] [INFO] [config.py:1005:print]   zero_optimization_stage ...... 0
[2025-05-11 19:40:53,448] [INFO] [config.py:991:print_user_config]   json = {
    "zero_optimization": {
        "stage": 0, 
        "allgather_partitions": true, 
        "allgather_bucket_size": 1.000000e+09, 
        "overlap_comm": false, 
        "reduce_scatter": true, 
        "reduce_bucket_size": 1.000000e+09, 
        "contiguous_gradients": true
    }, 
    "fp16": {
        "enabled": false, 
        "auto_cast": true, 
        "loss_scale": 0, 
        "initial_scale_power": 32, 
        "loss_scale_window": 1000, 
        "hysteresis": 2, 
        "min_loss_scale": 1
    }, 
    "bf16": {
        "enabled": true
    }, 
    "gradient_accumulation_steps": 2, 
    "gradient_clipping": 1.0, 
    "steps_per_print": inf, 
    "train_batch_size": 14, 
    "train_micro_batch_size_per_gpu": 1, 
    "wall_clock_breakdown": true
}
wandb: Currently logged in as: kolerk to https://api.wandb.ai. Use `wandb login --relogin` to force relogin
wandb: Using wandb-core as the SDK backend.  Please refer to https://wandb.me/wandb-core for more information.
wandb: Tracking run with wandb version 0.19.6
wandb: Run data is saved locally in /export3/huangdongchi/hdc_debug/R1-V/src/scripts/wandb/run-20250511_194142-30tmzupd
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run gen_mix_math_7b
wandb: ⭐️ View project at https://wandb.ai/kolerk/huggingface
wandb: 🚀 View run at https://wandb.ai/kolerk/huggingface/runs/30tmzupd

  0%|          | 0/287 [00:00<?, ?it/s]WARNING 05-11 19:41:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:41:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:41:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:41:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:41:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:41:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:41:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  0%|          | 1/287 [01:06<5:17:08, 66.53s/it]
                                                 
{'loss': 0.0, 'grad_norm': 1.7112301588058472, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5714286118745804, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.5535714626312256, 'reward_std': 0.1785714402794838, 'completion_length': 157.58929443359375, 'kl': 0.0, 'epoch': 0.0}

  0%|          | 1/287 [01:06<5:17:08, 66.53s/it]WARNING 05-11 19:42:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  1%|          | 2/287 [01:38<3:40:43, 46.47s/it]
                                                 
{'loss': 0.0, 'grad_norm': 1.907878041267395, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 1.0, 'reward': 1.3214285969734192, 'reward_std': 0.11266787722706795, 'completion_length': 125.21428680419922, 'kl': 0.000240325927734375, 'epoch': 0.0}

  1%|          | 2/287 [01:38<3:40:43, 46.47s/it]WARNING 05-11 19:43:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:43:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  1%|          | 3/287 [03:11<5:19:23, 67.48s/it]
                                                 
{'loss': 0.0, 'grad_norm': 1.2522495985031128, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.12500000931322575, 'rewards/format_reward': 0.9285714626312256, 'reward': 1.0535714626312256, 'reward_std': 0.26956598460674286, 'completion_length': 261.5178680419922, 'kl': 0.0002613067626953125, 'epoch': 0.01}

  1%|          | 3/287 [03:11<5:19:23, 67.48s/it]WARNING 05-11 19:44:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:44:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  1%|▏         | 4/287 [04:14<5:10:58, 65.93s/it]
                                                 
{'loss': 0.0, 'grad_norm': 2.4822638034820557, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1428571492433548, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.1071429252624512, 'reward_std': 0.1428571492433548, 'completion_length': 138.14286041259766, 'kl': 0.00023508071899414062, 'epoch': 0.01}

  1%|▏         | 4/287 [04:15<5:10:58, 65.93s/it]WARNING 05-11 19:45:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:45:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  2%|▏         | 5/287 [04:52<4:21:58, 55.74s/it]
                                                 
{'loss': 0.0, 'grad_norm': 0.2157951295375824, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 1.0, 'reward': 1.3035715222358704, 'reward_std': 0.0357142873108387, 'completion_length': 187.01786422729492, 'kl': 0.00038051605224609375, 'epoch': 0.01}

  2%|▏         | 5/287 [04:52<4:21:58, 55.74s/it]WARNING 05-11 19:46:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:46:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  2%|▏         | 6/287 [05:51<4:25:53, 56.77s/it]
                                                 
{'loss': 0.0, 'grad_norm': 1.3381389379501343, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.321428656578064, 'reward_std': 0.1539071872830391, 'completion_length': 198.67858123779297, 'kl': 0.0006351470947265625, 'epoch': 0.01}

  2%|▏         | 6/287 [05:51<4:25:53, 56.77s/it]WARNING 05-11 19:47:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:47:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  2%|▏         | 7/287 [06:56<4:37:10, 59.39s/it]
                                                 
{'loss': 0.0, 'grad_norm': 1.6880728006362915, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1785714402794838, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.160714328289032, 'reward_std': 0.21981073170900345, 'completion_length': 128.19643783569336, 'kl': 0.0006971359252929688, 'epoch': 0.01}

  2%|▏         | 7/287 [06:56<4:37:10, 59.39s/it]WARNING 05-11 19:48:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:48:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  3%|▎         | 8/287 [07:58<4:40:30, 60.33s/it]
                                                 
{'loss': 0.0, 'grad_norm': 2.249387264251709, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.1785714626312256, 'reward_std': 0.2142857238650322, 'completion_length': 130.14286422729492, 'kl': 0.0009641647338867188, 'epoch': 0.01}

  3%|▎         | 8/287 [07:58<4:40:30, 60.33s/it]WARNING 05-11 19:49:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:49:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:49:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:49:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:49:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:49:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:49:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:50:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:50:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:50:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:50:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:50:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:50:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:50:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  3%|▎         | 9/287 [09:29<5:24:05, 69.95s/it]
                                                 
{'loss': 0.0, 'grad_norm': 1.7473502159118652, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857164144516, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.1785714626312256, 'reward_std': 0.25552501529455185, 'completion_length': 212.5714340209961, 'kl': 0.0006227493286132812, 'epoch': 0.02}

  3%|▎         | 9/287 [09:29<5:24:05, 69.95s/it]WARNING 05-11 19:51:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:51:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  3%|▎         | 10/287 [11:01<5:53:29, 76.57s/it]
                                                  
{'loss': 0.0, 'grad_norm': 2.043368339538574, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.267857164144516, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.2321429252624512, 'reward_std': 0.2500000149011612, 'completion_length': 162.83929443359375, 'kl': 0.001018524169921875, 'epoch': 0.02}

  3%|▎         | 10/287 [11:01<5:53:29, 76.57s/it]WARNING 05-11 19:52:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:52:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:52:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:52:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:52:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:52:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:52:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  4%|▍         | 11/287 [12:02<5:30:27, 71.84s/it]
                                                  
{'loss': 0.0, 'grad_norm': 1.696097493171692, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3214285969734192, 'rewards/format_reward': 1.0, 'reward': 1.321428656578064, 'reward_std': 0.1539071835577488, 'completion_length': 148.6964340209961, 'kl': 0.0011081695556640625, 'epoch': 0.02}

  4%|▍         | 11/287 [12:02<5:30:27, 71.84s/it]WARNING 05-11 19:53:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:53:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  4%|▍         | 12/287 [12:25<4:22:03, 57.17s/it]
                                                  
{'loss': 0.0001, 'grad_norm': 2.0243589878082275, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857143059372902, 'rewards/format_reward': 1.0, 'reward': 1.285714328289032, 'reward_std': 0.18409645557403564, 'completion_length': 85.37500381469727, 'kl': 0.001636505126953125, 'epoch': 0.02}

  4%|▍         | 12/287 [12:25<4:22:03, 57.17s/it]WARNING 05-11 19:54:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:54:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  5%|▍         | 13/287 [13:28<4:29:14, 58.96s/it]
                                                  
{'loss': 0.0003, 'grad_norm': 1.473272681236267, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.25, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2321428656578064, 'reward_std': 0.14838216826319695, 'completion_length': 146.76786041259766, 'kl': 0.0074920654296875, 'epoch': 0.02}

  5%|▍         | 13/287 [13:28<4:29:14, 58.96s/it]WARNING 05-11 19:55:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:55:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  5%|▍         | 14/287 [14:27<4:27:48, 58.86s/it]
                                                  
{'loss': 0.0001, 'grad_norm': 1.2067612409591675, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714328289032, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.285714328289032, 'reward_std': 0.1428571492433548, 'completion_length': 137.67858123779297, 'kl': 0.002655029296875, 'epoch': 0.02}

  5%|▍         | 14/287 [14:27<4:27:48, 58.86s/it]WARNING 05-11 19:56:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  5%|▌         | 15/287 [15:05<3:58:44, 52.67s/it]
                                                  
{'loss': 0.0002, 'grad_norm': 0.39365991950035095, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1250000074505806, 'rewards/format_reward': 1.0, 'reward': 1.1250000596046448, 'reward_std': 0.0357142873108387, 'completion_length': 107.78572082519531, 'kl': 0.006256103515625, 'epoch': 0.03}

  5%|▌         | 15/287 [15:05<3:58:44, 52.67s/it]WARNING 05-11 19:56:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:56:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  6%|▌         | 16/287 [16:04<4:05:33, 54.37s/it]
                                                  
{'loss': 0.0001, 'grad_norm': 2.6520118713378906, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428656578064, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3392857313156128, 'reward_std': 0.2610500305891037, 'completion_length': 123.46429061889648, 'kl': 0.00353240966796875, 'epoch': 0.03}

  6%|▌         | 16/287 [16:04<4:05:33, 54.37s/it]WARNING 05-11 19:57:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:57:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  6%|▌         | 17/287 [16:29<3:25:00, 45.56s/it]
                                                  
{'loss': 0.0002, 'grad_norm': 2.0858123302459717, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 1.0, 'reward': 1.4642857909202576, 'reward_std': 0.1428571492433548, 'completion_length': 50.50000286102295, 'kl': 0.0052490234375, 'epoch': 0.03}

  6%|▌         | 17/287 [16:29<3:25:00, 45.56s/it]WARNING 05-11 19:58:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  6%|▋         | 18/287 [16:53<2:55:24, 39.13s/it]
                                                  
{'loss': 0.0002, 'grad_norm': 1.9496022462844849, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714477300644, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.19514649361371994, 'completion_length': 63.10714530944824, 'kl': 0.00521087646484375, 'epoch': 0.03}

  6%|▋         | 18/287 [16:53<2:55:24, 39.13s/it]WARNING 05-11 19:58:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:58:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  7%|▋         | 19/287 [17:56<3:26:19, 46.19s/it]
                                                  
{'loss': 0.0002, 'grad_norm': 2.6978378295898438, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857313156128, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.1785714626312256, 'reward_std': 0.25552503019571304, 'completion_length': 145.30358123779297, 'kl': 0.006256103515625, 'epoch': 0.03}

  7%|▋         | 19/287 [17:56<3:26:19, 46.19s/it]WARNING 05-11 19:59:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 19:59:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  7%|▋         | 20/287 [18:34<3:14:40, 43.75s/it]
                                                  
{'loss': 0.0003, 'grad_norm': 1.9650906324386597, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.17857144214212894, 'rewards/format_reward': 1.0, 'reward': 1.1785715222358704, 'reward_std': 0.11266787722706795, 'completion_length': 76.42857360839844, 'kl': 0.0084075927734375, 'epoch': 0.03}

  7%|▋         | 20/287 [18:34<3:14:40, 43.75s/it]WARNING 05-11 20:00:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  7%|▋         | 21/287 [18:56<2:46:03, 37.46s/it]
                                                  
{'loss': 0.0003, 'grad_norm': 1.931198000907898, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.1071428619325161, 'completion_length': 66.23214721679688, 'kl': 0.007598876953125, 'epoch': 0.04}

  7%|▋         | 21/287 [18:56<2:46:03, 37.46s/it]WARNING 05-11 20:00:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:00:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  8%|▊         | 22/287 [19:44<2:59:15, 40.59s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 3.495482921600342, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571529686451, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2500000596046448, 'reward_std': 0.2142857313156128, 'completion_length': 96.17857503890991, 'kl': 0.01171875, 'epoch': 0.04}

  8%|▊         | 22/287 [19:44<2:59:15, 40.59s/it]WARNING 05-11 20:01:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:01:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  8%|▊         | 23/287 [20:45<3:25:19, 46.67s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 2.9820516109466553, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3392857909202576, 'reward_std': 0.20670334622263908, 'completion_length': 109.5, 'kl': 0.011871337890625, 'epoch': 0.04}

  8%|▊         | 23/287 [20:45<3:25:19, 46.67s/it]WARNING 05-11 20:02:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  8%|▊         | 24/287 [21:11<2:57:25, 40.48s/it]
                                                  
{'loss': 0.0004, 'grad_norm': 2.1632943153381348, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.196428582072258, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.14838216453790665, 'completion_length': 63.392860412597656, 'kl': 0.00897216796875, 'epoch': 0.04}

  8%|▊         | 24/287 [21:11<2:57:25, 40.48s/it]WARNING 05-11 20:02:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:02:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  9%|▊         | 25/287 [21:33<2:32:56, 35.02s/it]
                                                  
{'loss': 0.0006, 'grad_norm': 2.4243154525756836, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 1.0, 'reward': 1.2857143878936768, 'reward_std': 0.0714285746216774, 'completion_length': 51.21428680419922, 'kl': 0.01458740234375, 'epoch': 0.04}

  9%|▊         | 25/287 [21:33<2:32:56, 35.02s/it]WARNING 05-11 20:03:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  9%|▉         | 26/287 [22:02<2:24:13, 33.16s/it]
                                                  
{'loss': 0.0004, 'grad_norm': 3.1326897144317627, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 1.0, 'reward': 1.3035714626312256, 'reward_std': 0.14838216453790665, 'completion_length': 69.94643020629883, 'kl': 0.0103759765625, 'epoch': 0.05}

  9%|▉         | 26/287 [22:02<2:24:13, 33.16s/it]WARNING 05-11 20:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

  9%|▉         | 27/287 [22:34<2:22:23, 32.86s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 2.6274008750915527, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2500000149011612, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2321428656578064, 'reward_std': 0.07695359364151955, 'completion_length': 73.53571701049805, 'kl': 0.012725830078125, 'epoch': 0.05}

  9%|▉         | 27/287 [22:34<2:22:23, 32.86s/it]WARNING 05-11 20:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 10%|▉         | 28/287 [23:04<2:17:26, 31.84s/it]
                                                  
{'loss': 0.0006, 'grad_norm': 3.6346542835235596, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.267857164144516, 'rewards/format_reward': 1.0, 'reward': 1.2678571939468384, 'reward_std': 0.21981074661016464, 'completion_length': 45.50000190734863, 'kl': 0.015228271484375, 'epoch': 0.05}

 10%|▉         | 28/287 [23:04<2:17:26, 31.84s/it]WARNING 05-11 20:04:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:04:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 10%|█         | 29/287 [24:00<2:47:57, 39.06s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 3.283210277557373, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714626312256, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.3928571939468384, 'reward_std': 0.24695909023284912, 'completion_length': 121.64286422729492, 'kl': 0.0167236328125, 'epoch': 0.05}

 10%|█         | 29/287 [24:00<2:47:57, 39.06s/it]WARNING 05-11 20:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:05:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 10%|█         | 30/287 [24:57<3:10:28, 44.47s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 3.344606876373291, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571492433548, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.25, 'reward_std': 0.2142857313156128, 'completion_length': 99.94643020629883, 'kl': 0.01702880859375, 'epoch': 0.05}

 10%|█         | 30/287 [24:57<3:10:28, 44.47s/it]WARNING 05-11 20:06:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 11%|█         | 31/287 [25:22<2:44:49, 38.63s/it]
                                                  
{'loss': 0.001, 'grad_norm': 3.107051372528076, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 1.0, 'reward': 1.285714328289032, 'reward_std': 0.11266787722706795, 'completion_length': 49.28571796417236, 'kl': 0.0255126953125, 'epoch': 0.05}

 11%|█         | 31/287 [25:22<2:44:49, 38.63s/it]WARNING 05-11 20:07:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 11%|█         | 32/287 [25:48<2:28:33, 34.96s/it]
                                                  
{'loss': 0.0004, 'grad_norm': 2.116110324859619, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4464285969734192, 'reward_std': 0.1071428619325161, 'completion_length': 35.66071605682373, 'kl': 0.009490966796875, 'epoch': 0.06}

 11%|█         | 32/287 [25:48<2:28:33, 34.96s/it]WARNING 05-11 20:07:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 11%|█▏        | 33/287 [26:01<1:59:32, 28.24s/it]
                                                  
{'loss': 0.0009, 'grad_norm': 2.8921761512756348, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.07695358991622925, 'completion_length': 24.160715103149414, 'kl': 0.0218505859375, 'epoch': 0.06}

 11%|█▏        | 33/287 [26:01<1:59:32, 28.24s/it]WARNING 05-11 20:07:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:07:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 12%|█▏        | 34/287 [26:30<2:00:40, 28.62s/it]
                                                  
{'loss': 0.0014, 'grad_norm': 1.8730958700180054, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857909202576, 'reward_std': 0.07695359364151955, 'completion_length': 49.23214530944824, 'kl': 0.03411865234375, 'epoch': 0.06}

 12%|█▏        | 34/287 [26:30<2:00:40, 28.62s/it]WARNING 05-11 20:08:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 12%|█▏        | 35/287 [27:12<2:17:04, 32.64s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 2.1758477687835693, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2500000149011612, 'rewards/format_reward': 1.0, 'reward': 1.2500000596046448, 'reward_std': 0.11266787722706795, 'completion_length': 71.71429061889648, 'kl': 0.0174560546875, 'epoch': 0.06}

 12%|█▏        | 35/287 [27:12<2:17:04, 32.64s/it]WARNING 05-11 20:08:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 13%|█▎        | 36/287 [27:41<2:11:45, 31.50s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 4.160538196563721, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107143133878708, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.3750000596046448, 'reward_std': 0.20670334994792938, 'completion_length': 60.05357551574707, 'kl': 0.017578125, 'epoch': 0.06}

 13%|█▎        | 36/287 [27:41<2:11:45, 31.50s/it]WARNING 05-11 20:09:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 13%|█▎        | 37/287 [28:03<1:58:34, 28.46s/it]
                                                  
{'loss': 0.0009, 'grad_norm': 0.2934674322605133, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714477300644, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.0, 'completion_length': 35.589287757873535, 'kl': 0.021759033203125, 'epoch': 0.06}

 13%|█▎        | 37/287 [28:03<1:58:34, 28.46s/it]WARNING 05-11 20:09:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:09:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 13%|█▎        | 38/287 [28:27<1:52:40, 27.15s/it]
                                                  
{'loss': 0.0006, 'grad_norm': 1.3442217111587524, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.0357142873108387, 'completion_length': 41.50000190734863, 'kl': 0.0150146484375, 'epoch': 0.07}

 13%|█▎        | 38/287 [28:27<1:52:40, 27.15s/it]WARNING 05-11 20:10:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 14%|█▎        | 39/287 [28:53<1:51:08, 26.89s/it]
                                                  
{'loss': 0.0022, 'grad_norm': 1.3110960721969604, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.196428582072258, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.0357142873108387, 'completion_length': 62.71428680419922, 'kl': 0.055908203125, 'epoch': 0.07}

 14%|█▎        | 39/287 [28:53<1:51:08, 26.89s/it]WARNING 05-11 20:10:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:10:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 14%|█▍        | 40/287 [29:49<2:26:52, 35.68s/it]
                                                  
{'loss': 0.0014, 'grad_norm': 1.4748375415802002, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1785714328289032, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.160714328289032, 'reward_std': 0.1071428619325161, 'completion_length': 78.35714721679688, 'kl': 0.03466796875, 'epoch': 0.07}

 14%|█▍        | 40/287 [29:49<2:26:52, 35.68s/it]WARNING 05-11 20:11:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 14%|█▍        | 41/287 [30:00<1:56:08, 28.33s/it]
                                                  
{'loss': 0.002, 'grad_norm': 3.0263631343841553, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.1181928962469101, 'completion_length': 22.10714340209961, 'kl': 0.0496826171875, 'epoch': 0.07}

 14%|█▍        | 41/287 [30:00<1:56:08, 28.33s/it]WARNING 05-11 20:11:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:11:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 15%|█▍        | 42/287 [30:22<1:47:25, 26.31s/it]
                                                  
{'loss': 0.0006, 'grad_norm': 3.437392234802246, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.7321428954601288, 'rewards/format_reward': 1.0, 'reward': 1.7321429252624512, 'reward_std': 0.1071428619325161, 'completion_length': 48.60714530944824, 'kl': 0.013916015625, 'epoch': 0.07}

 15%|█▍        | 42/287 [30:22<1:47:25, 26.31s/it]WARNING 05-11 20:12:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 15%|█▍        | 43/287 [30:37<1:33:18, 22.94s/it]
                                                  
{'loss': 0.0009, 'grad_norm': 0.37258899211883545, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.232142873108387, 'rewards/format_reward': 1.0, 'reward': 1.2321429252624512, 'reward_std': 0.0357142873108387, 'completion_length': 35.41071605682373, 'kl': 0.0218505859375, 'epoch': 0.07}

 15%|█▍        | 43/287 [30:37<1:33:18, 22.94s/it]WARNING 05-11 20:12:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:12:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 15%|█▌        | 44/287 [31:31<2:10:52, 32.32s/it]
                                                  
{'loss': 0.0024, 'grad_norm': 4.813842296600342, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.446428582072258, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4285714626312256, 'reward_std': 0.1428571529686451, 'completion_length': 63.14285850524902, 'kl': 0.0596923828125, 'epoch': 0.08}

 15%|█▌        | 44/287 [31:31<2:10:52, 32.32s/it]WARNING 05-11 20:13:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 16%|█▌        | 45/287 [32:01<2:07:06, 31.51s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 3.699773073196411, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714328289032, 'rewards/format_reward': 1.0, 'reward': 1.4285714626312256, 'reward_std': 0.0714285746216774, 'completion_length': 38.94643020629883, 'kl': 0.0206298828125, 'epoch': 0.08}

 16%|█▌        | 45/287 [32:01<2:07:06, 31.51s/it]WARNING 05-11 20:13:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:13:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 16%|█▌        | 46/287 [33:00<2:40:16, 39.90s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 1.6618400812149048, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107143133878708, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3928572535514832, 'reward_std': 0.12974976003170013, 'completion_length': 70.80357360839844, 'kl': 0.01934814453125, 'epoch': 0.08}

 16%|█▌        | 46/287 [33:00<2:40:16, 39.90s/it]WARNING 05-11 20:14:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:14:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 16%|█▋        | 47/287 [33:16<2:10:24, 32.60s/it]
                                                  
{'loss': 0.0013, 'grad_norm': 5.388141632080078, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 1.0, 'reward': 1.3214285969734192, 'reward_std': 0.11266787722706795, 'completion_length': 28.17857265472412, 'kl': 0.0313720703125, 'epoch': 0.08}

 16%|█▋        | 47/287 [33:16<2:10:24, 32.60s/it]WARNING 05-11 20:15:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 17%|█▋        | 48/287 [33:43<2:03:38, 31.04s/it]
                                                  
{'loss': 0.0011, 'grad_norm': 2.7862019538879395, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 1.0, 'reward': 1.3035715222358704, 'reward_std': 0.0357142873108387, 'completion_length': 38.89285945892334, 'kl': 0.026611328125, 'epoch': 0.08}

 17%|█▋        | 48/287 [33:43<2:03:38, 31.04s/it]WARNING 05-11 20:15:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 17%|█▋        | 49/287 [34:14<2:02:51, 30.97s/it]
                                                  
{'loss': 0.0006, 'grad_norm': 0.12415573745965958, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857238650322, 'rewards/format_reward': 1.0, 'reward': 1.2142857909202576, 'reward_std': 0.0, 'completion_length': 49.12500190734863, 'kl': 0.01556396484375, 'epoch': 0.09}

 17%|█▋        | 49/287 [34:14<2:02:51, 30.97s/it]WARNING 05-11 20:15:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:15:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:16:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:16:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 17%|█▋        | 50/287 [35:16<2:39:00, 40.26s/it]
                                                  
{'loss': 0.0017, 'grad_norm': 3.0641849040985107, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.05357143096625805, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.035714328289032, 'reward_std': 0.1428571492433548, 'completion_length': 119.17857360839844, 'kl': 0.0421142578125, 'epoch': 0.09}

 17%|█▋        | 50/287 [35:16<2:39:00, 40.26s/it]WARNING 05-11 20:17:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 18%|█▊        | 51/287 [35:32<2:09:21, 32.89s/it]
                                                  
{'loss': 0.0022, 'grad_norm': 0.9872962832450867, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.357142873108387, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.0, 'completion_length': 29.87500238418579, 'kl': 0.054473876953125, 'epoch': 0.09}

 18%|█▊        | 51/287 [35:32<2:09:21, 32.89s/it]WARNING 05-11 20:17:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 18%|█▊        | 52/287 [35:59<2:02:46, 31.35s/it]
                                                  
{'loss': 0.0024, 'grad_norm': 3.283104658126831, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000074505806, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.1071428619325161, 'completion_length': 40.285715103149414, 'kl': 0.059326171875, 'epoch': 0.09}

 18%|█▊        | 52/287 [35:59<2:02:46, 31.35s/it]WARNING 05-11 20:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 18%|█▊        | 53/287 [36:23<1:53:35, 29.12s/it]
                                                  
{'loss': 0.0014, 'grad_norm': 4.111879825592041, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.1181928962469101, 'completion_length': 31.732144355773926, 'kl': 0.033966064453125, 'epoch': 0.09}

 18%|█▊        | 53/287 [36:23<1:53:35, 29.12s/it]WARNING 05-11 20:18:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 19%|█▉        | 54/287 [36:44<1:43:39, 26.69s/it]
                                                  
{'loss': 0.0012, 'grad_norm': 0.08347596228122711, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000149011612, 'rewards/format_reward': 1.0, 'reward': 1.5000001192092896, 'reward_std': 0.0, 'completion_length': 40.55357360839844, 'kl': 0.029296875, 'epoch': 0.09}

 19%|█▉        | 54/287 [36:44<1:43:39, 26.69s/it]WARNING 05-11 20:18:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 19%|█▉        | 55/287 [36:58<1:27:41, 22.68s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 0.0831049457192421, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000298023224, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.0, 'completion_length': 31.321430206298828, 'kl': 0.01800537109375, 'epoch': 0.1}

 19%|█▉        | 55/287 [36:58<1:27:41, 22.68s/it]WARNING 05-11 20:18:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 20%|█▉        | 56/287 [37:09<1:14:29, 19.35s/it]
                                                  
{'loss': 0.0009, 'grad_norm': 0.20994843542575836, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714626312256, 'rewards/format_reward': 1.0, 'reward': 1.4285714626312256, 'reward_std': 0.0, 'completion_length': 20.535715103149414, 'kl': 0.022705078125, 'epoch': 0.1}

 20%|█▉        | 56/287 [37:09<1:14:29, 19.35s/it]WARNING 05-11 20:18:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:18:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 20%|█▉        | 57/287 [37:32<1:18:23, 20.45s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 5.273396015167236, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428656578064, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.1896214634180069, 'completion_length': 40.25000286102295, 'kl': 0.02105712890625, 'epoch': 0.1}

 20%|█▉        | 57/287 [37:32<1:18:23, 20.45s/it]WARNING 05-11 20:19:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 20%|██        | 58/287 [37:54<1:19:18, 20.78s/it]
                                                  
{'loss': 0.0011, 'grad_norm': 5.009562015533447, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 1.0, 'reward': 1.4642857313156128, 'reward_std': 0.18409644439816475, 'completion_length': 28.714287757873535, 'kl': 0.02630615234375, 'epoch': 0.1}

 20%|██        | 58/287 [37:54<1:19:18, 20.78s/it]WARNING 05-11 20:19:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:19:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 21%|██        | 59/287 [38:35<1:41:57, 26.83s/it]
                                                  
{'loss': 0.0004, 'grad_norm': 0.8417385220527649, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.285714328289032, 'reward_std': 0.0714285746216774, 'completion_length': 72.51786041259766, 'kl': 0.009490966796875, 'epoch': 0.1}

 21%|██        | 59/287 [38:35<1:41:57, 26.83s/it]WARNING 05-11 20:20:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 21%|██        | 60/287 [38:59<1:38:03, 25.92s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 2.719637870788574, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3928571939468384, 'reward_std': 0.11266787722706795, 'completion_length': 65.21428680419922, 'kl': 0.017669677734375, 'epoch': 0.1}

 21%|██        | 60/287 [38:59<1:38:03, 25.92s/it]WARNING 05-11 20:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 21%|██▏       | 61/287 [39:20<1:32:15, 24.49s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 4.035680770874023, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857313156128, 'rewards/format_reward': 1.0, 'reward': 1.2142857313156128, 'reward_std': 0.2253357619047165, 'completion_length': 37.62500190734863, 'kl': 0.0185546875, 'epoch': 0.11}

 21%|██▏       | 61/287 [39:20<1:32:15, 24.49s/it]WARNING 05-11 20:21:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 22%|██▏       | 62/287 [39:36<1:22:32, 22.01s/it]
                                                  
{'loss': 0.0004, 'grad_norm': 1.6929913759231567, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.7142857313156128, 'rewards/format_reward': 1.0, 'reward': 1.7142858505249023, 'reward_std': 0.0714285746216774, 'completion_length': 34.71428680419922, 'kl': 0.010986328125, 'epoch': 0.11}

 22%|██▏       | 62/287 [39:36<1:22:32, 22.01s/it]WARNING 05-11 20:21:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 22%|██▏       | 63/287 [39:52<1:15:38, 20.26s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 2.3981828689575195, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428656578064, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4642857909202576, 'reward_std': 0.1428571492433548, 'completion_length': 30.464287757873535, 'kl': 0.0126953125, 'epoch': 0.11}

 22%|██▏       | 63/287 [39:52<1:15:38, 20.26s/it]WARNING 05-11 20:21:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 22%|██▏       | 64/287 [40:05<1:06:40, 17.94s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 3.2482030391693115, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 1.0, 'reward': 1.285714328289032, 'reward_std': 0.18409644439816475, 'completion_length': 26.571430206298828, 'kl': 0.012908935546875, 'epoch': 0.11}

 22%|██▏       | 64/287 [40:05<1:06:40, 17.94s/it]WARNING 05-11 20:21:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:21:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 23%|██▎       | 65/287 [40:32<1:17:13, 20.87s/it]
                                                  
{'loss': 0.0011, 'grad_norm': 2.2745487689971924, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2321428656578064, 'rewards/format_reward': 1.0, 'reward': 1.2321429252624512, 'reward_std': 0.07695359364151955, 'completion_length': 56.41071701049805, 'kl': 0.028106689453125, 'epoch': 0.11}

 23%|██▎       | 65/287 [40:32<1:17:13, 20.87s/it]WARNING 05-11 20:22:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:22:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 23%|██▎       | 66/287 [41:31<1:58:11, 32.09s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 1.8214013576507568, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4285714626312256, 'reward_std': 0.1428571492433548, 'completion_length': 75.53571510314941, 'kl': 0.0133056640625, 'epoch': 0.11}

 23%|██▎       | 66/287 [41:31<1:58:11, 32.09s/it]WARNING 05-11 20:23:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 23%|██▎       | 67/287 [42:03<1:57:47, 32.13s/it]
                                                  
{'loss': 0.0017, 'grad_norm': 1.9513810873031616, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.321428656578064, 'reward_std': 0.11266787722706795, 'completion_length': 60.16071701049805, 'kl': 0.042724609375, 'epoch': 0.12}

 23%|██▎       | 67/287 [42:03<1:57:47, 32.13s/it]WARNING 05-11 20:23:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:23:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 24%|██▎       | 68/287 [42:21<1:41:26, 27.79s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 2.7849574089050293, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1785714328289032, 'rewards/format_reward': 1.0, 'reward': 1.1785714626312256, 'reward_std': 0.11266787722706795, 'completion_length': 56.321430683135986, 'kl': 0.01947021484375, 'epoch': 0.12}

 24%|██▎       | 68/287 [42:21<1:41:26, 27.79s/it]WARNING 05-11 20:24:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 24%|██▍       | 69/287 [42:55<1:47:46, 29.66s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 2.4288578033447266, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.07695358991622925, 'completion_length': 78.66071701049805, 'kl': 0.0191650390625, 'epoch': 0.12}

 24%|██▍       | 69/287 [42:55<1:47:46, 29.66s/it]WARNING 05-11 20:24:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:24:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 24%|██▍       | 70/287 [43:19<1:41:48, 28.15s/it]
                                                  
{'loss': 0.0004, 'grad_norm': 2.5948646068573, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2500000149011612, 'rewards/format_reward': 1.0, 'reward': 1.2500000596046448, 'reward_std': 0.1428571492433548, 'completion_length': 79.1785774230957, 'kl': 0.009124755859375, 'epoch': 0.12}

 24%|██▍       | 70/287 [43:19<1:41:48, 28.15s/it]WARNING 05-11 20:25:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:25:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 25%|██▍       | 71/287 [44:20<2:16:52, 38.02s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 0.5350293517112732, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857143059372902, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.0357142873108387, 'completion_length': 90.76786041259766, 'kl': 0.012908935546875, 'epoch': 0.12}

 25%|██▍       | 71/287 [44:20<2:16:52, 38.02s/it]WARNING 05-11 20:26:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 25%|██▌       | 72/287 [45:10<2:29:07, 41.62s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 3.6734235286712646, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 1.0, 'reward': 1.4642857313156128, 'reward_std': 0.11266787722706795, 'completion_length': 81.16071701049805, 'kl': 0.0172119140625, 'epoch': 0.13}

 25%|██▌       | 72/287 [45:10<2:29:07, 41.62s/it]WARNING 05-11 20:26:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:26:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 25%|██▌       | 73/287 [45:32<2:07:03, 35.62s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 3.068169355392456, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142873108387, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.14838216453790665, 'completion_length': 45.16071796417236, 'kl': 0.01324462890625, 'epoch': 0.13}

 25%|██▌       | 73/287 [45:32<2:07:03, 35.62s/it]WARNING 05-11 20:27:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 26%|██▌       | 74/287 [46:00<1:58:43, 33.45s/it]
                                                  
{'loss': 0.0017, 'grad_norm': 4.254462242126465, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107143133878708, 'rewards/format_reward': 1.0, 'reward': 1.410714328289032, 'reward_std': 0.1896214708685875, 'completion_length': 56.21428680419922, 'kl': 0.04150390625, 'epoch': 0.13}

 26%|██▌       | 74/287 [46:00<1:58:43, 33.45s/it]WARNING 05-11 20:27:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:27:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 26%|██▌       | 75/287 [46:32<1:56:23, 32.94s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 4.088119983673096, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1785714365541935, 'rewards/format_reward': 1.0, 'reward': 1.1785715222358704, 'reward_std': 0.11266788095235825, 'completion_length': 72.94643020629883, 'kl': 0.0191650390625, 'epoch': 0.13}

 26%|██▌       | 75/287 [46:32<1:56:23, 32.94s/it]WARNING 05-11 20:28:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 26%|██▋       | 76/287 [46:54<1:44:26, 29.70s/it]
                                                  
{'loss': 0.0003, 'grad_norm': 2.4468464851379395, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.375, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.14838216453790665, 'completion_length': 57.07143020629883, 'kl': 0.0087432861328125, 'epoch': 0.13}

 26%|██▋       | 76/287 [46:54<1:44:26, 29.70s/it]WARNING 05-11 20:28:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 27%|██▋       | 77/287 [47:29<1:49:18, 31.23s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 3.837797164916992, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.357142873108387, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.11266788095235825, 'completion_length': 78.03571701049805, 'kl': 0.013763427734375, 'epoch': 0.13}

 27%|██▋       | 77/287 [47:29<1:49:18, 31.23s/it]WARNING 05-11 20:29:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:29:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 27%|██▋       | 78/287 [48:27<2:17:02, 39.34s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 3.6129231452941895, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3035714626312256, 'reward_std': 0.21981073915958405, 'completion_length': 113.73214721679688, 'kl': 0.02099609375, 'epoch': 0.14}

 27%|██▋       | 78/287 [48:27<2:17:02, 39.34s/it]WARNING 05-11 20:30:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 28%|██▊       | 79/287 [48:59<2:08:40, 37.12s/it]
                                                  
{'loss': 0.0013, 'grad_norm': 2.1836588382720947, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3214285969734192, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3035714626312256, 'reward_std': 0.07695358991622925, 'completion_length': 80.85714721679688, 'kl': 0.032318115234375, 'epoch': 0.14}

 28%|██▊       | 79/287 [48:59<2:08:40, 37.12s/it]WARNING 05-11 20:30:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:30:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 28%|██▊       | 80/287 [49:39<2:10:26, 37.81s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 3.3099546432495117, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5357143133878708, 'rewards/format_reward': 1.0, 'reward': 1.535714328289032, 'reward_std': 0.11266787722706795, 'completion_length': 90.66072082519531, 'kl': 0.013275146484375, 'epoch': 0.14}

 28%|██▊       | 80/287 [49:39<2:10:26, 37.81s/it]WARNING 05-11 20:31:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:31:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 28%|██▊       | 81/287 [50:39<2:32:59, 44.56s/it]
                                                  
{'loss': 0.0009, 'grad_norm': 3.2098422050476074, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142873108387, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.1896214634180069, 'completion_length': 107.6964340209961, 'kl': 0.02142333984375, 'epoch': 0.14}

 28%|██▊       | 81/287 [50:39<2:32:59, 44.56s/it]WARNING 05-11 20:32:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 29%|██▊       | 82/287 [51:06<2:14:39, 39.41s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 3.698056221008301, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857499420643, 'rewards/format_reward': 1.0, 'reward': 1.4642857909202576, 'reward_std': 0.11266788095235825, 'completion_length': 55.82143020629883, 'kl': 0.0128173828125, 'epoch': 0.14}

 29%|██▊       | 82/287 [51:06<2:14:39, 39.41s/it]WARNING 05-11 20:32:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:32:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 29%|██▉       | 83/287 [51:37<2:05:29, 36.91s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 3.004639148712158, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3928571939468384, 'reward_std': 0.1539071798324585, 'completion_length': 75.57143020629883, 'kl': 0.01849365234375, 'epoch': 0.14}

 29%|██▉       | 83/287 [51:37<2:05:29, 36.91s/it]WARNING 05-11 20:33:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 29%|██▉       | 84/287 [52:07<1:58:01, 34.89s/it]
                                                  
{'loss': 0.0009, 'grad_norm': 3.6212446689605713, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571492433548, 'rewards/format_reward': 1.0, 'reward': 1.2678571939468384, 'reward_std': 0.1896214783191681, 'completion_length': 113.42857360839844, 'kl': 0.021240234375, 'epoch': 0.15}

 29%|██▉       | 84/287 [52:07<1:58:01, 34.89s/it]WARNING 05-11 20:33:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:33:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 30%|██▉       | 85/287 [52:32<1:46:54, 31.75s/it]
                                                  
{'loss': 0.0007, 'grad_norm': 3.7707672119140625, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.660714328289032, 'rewards/format_reward': 1.0, 'reward': 1.6607143878936768, 'reward_std': 0.1181928962469101, 'completion_length': 61.41071701049805, 'kl': 0.017791748046875, 'epoch': 0.15}

 30%|██▉       | 85/287 [52:32<1:46:54, 31.75s/it]WARNING 05-11 20:34:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 30%|██▉       | 86/287 [52:57<1:39:58, 29.85s/it]
                                                  
{'loss': 0.0016, 'grad_norm': 3.547623634338379, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.535714328289032, 'rewards/format_reward': 1.0, 'reward': 1.5357143878936768, 'reward_std': 0.1539071835577488, 'completion_length': 83.10714340209961, 'kl': 0.039794921875, 'epoch': 0.15}

 30%|██▉       | 86/287 [52:57<1:39:58, 29.85s/it]WARNING 05-11 20:34:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:34:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 30%|███       | 87/287 [53:57<2:09:00, 38.70s/it]
                                                  
{'loss': 0.0019, 'grad_norm': 1.2902237176895142, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.01785714365541935, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.0000000596046448, 'reward_std': 0.0714285746216774, 'completion_length': 122.58928680419922, 'kl': 0.04705810546875, 'epoch': 0.15}

 30%|███       | 87/287 [53:57<2:09:00, 38.70s/it]WARNING 05-11 20:35:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:35:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 31%|███       | 88/287 [54:28<2:01:02, 36.49s/it]
                                                  
{'loss': 0.0016, 'grad_norm': 2.6160593032836914, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.0714285746216774, 'completion_length': 100.73214721679688, 'kl': 0.041015625, 'epoch': 0.15}

 31%|███       | 88/287 [54:28<2:01:02, 36.49s/it]WARNING 05-11 20:36:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 31%|███       | 89/287 [54:59<1:55:05, 34.87s/it]
                                                  
{'loss': 0.001, 'grad_norm': 5.252261638641357, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.25, 'rewards/format_reward': 1.0, 'reward': 1.25, 'reward_std': 0.1428571529686451, 'completion_length': 80.37500381469727, 'kl': 0.02618408203125, 'epoch': 0.16}

 31%|███       | 89/287 [54:59<1:55:05, 34.87s/it]WARNING 05-11 20:36:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 31%|███▏      | 90/287 [55:26<1:46:10, 32.34s/it]
                                                  
{'loss': 0.0008, 'grad_norm': 1.9157800674438477, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.14838216826319695, 'completion_length': 93.53572082519531, 'kl': 0.01971435546875, 'epoch': 0.16}

 31%|███▏      | 90/287 [55:26<1:46:10, 32.34s/it]WARNING 05-11 20:37:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 32%|███▏      | 91/287 [56:18<2:04:54, 38.24s/it]
                                                  
{'loss': 0.0015, 'grad_norm': 1.5380001068115234, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5714286118745804, 'rewards/format_reward': 1.0, 'reward': 1.571428656578064, 'reward_std': 0.1539071798324585, 'completion_length': 104.25000381469727, 'kl': 0.03857421875, 'epoch': 0.16}

 32%|███▏      | 91/287 [56:18<2:04:54, 38.24s/it]WARNING 05-11 20:38:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:38:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 32%|███▏      | 92/287 [57:24<2:31:47, 46.70s/it]
                                                  
{'loss': 0.0006, 'grad_norm': 4.105345249176025, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.446428656578064, 'reward_std': 0.21981073170900345, 'completion_length': 117.83928680419922, 'kl': 0.015838623046875, 'epoch': 0.16}

 32%|███▏      | 92/287 [57:24<2:31:47, 46.70s/it]WARNING 05-11 20:39:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:39:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 32%|███▏      | 93/287 [58:17<2:36:56, 48.54s/it]
                                                  
{'loss': 0.002, 'grad_norm': 1.2826452255249023, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107142984867096, 'rewards/format_reward': 1.0, 'reward': 1.410714328289032, 'reward_std': 0.1071428619325161, 'completion_length': 110.6785774230957, 'kl': 0.0499267578125, 'epoch': 0.16}

 32%|███▏      | 93/287 [58:17<2:36:56, 48.54s/it]WARNING 05-11 20:40:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 33%|███▎      | 94/287 [58:52<2:23:19, 44.55s/it]
                                                  
{'loss': 0.0005, 'grad_norm': 0.59459388256073, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 1.0, 'reward': 1.4464285969734192, 'reward_std': 0.0357142873108387, 'completion_length': 121.66072082519531, 'kl': 0.012603759765625, 'epoch': 0.16}

 33%|███▎      | 94/287 [58:52<2:23:19, 44.55s/it]WARNING 05-11 20:40:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:40:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 33%|███▎      | 95/287 [59:40<2:26:00, 45.63s/it]
                                                  
{'loss': 0.0017, 'grad_norm': 0.7918434739112854, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000074505806, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.0357142873108387, 'completion_length': 117.00000762939453, 'kl': 0.0423736572265625, 'epoch': 0.17}

 33%|███▎      | 95/287 [59:40<2:26:00, 45.63s/it]WARNING 05-11 20:41:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 33%|███▎      | 96/287 [1:00:04<2:04:30, 39.11s/it]
                                                    
{'loss': 0.0005, 'grad_norm': 1.1781704425811768, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428656578064, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.07695359364151955, 'completion_length': 88.87500381469727, 'kl': 0.012481689453125, 'epoch': 0.17}

 33%|███▎      | 96/287 [1:00:04<2:04:30, 39.11s/it]WARNING 05-11 20:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 34%|███▍      | 97/287 [1:01:07<2:26:45, 46.34s/it]
                                                    
{'loss': 0.0012, 'grad_norm': 4.976283073425293, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3035714626312256, 'reward_std': 0.1785714365541935, 'completion_length': 94.26786041259766, 'kl': 0.0306396484375, 'epoch': 0.17}

 34%|███▍      | 97/287 [1:01:07<2:26:45, 46.34s/it]WARNING 05-11 20:42:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:42:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 34%|███▍      | 98/287 [1:02:09<2:40:12, 50.86s/it]
                                                    
{'loss': 0.0011, 'grad_norm': 4.462428569793701, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1785714402794838, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.160714328289032, 'reward_std': 0.1071428619325161, 'completion_length': 138.98215103149414, 'kl': 0.02703857421875, 'epoch': 0.17}

 34%|███▍      | 98/287 [1:02:09<2:40:12, 50.86s/it]WARNING 05-11 20:43:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:43:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 34%|███▍      | 99/287 [1:02:33<2:14:35, 42.96s/it]
                                                    
{'loss': 0.0006, 'grad_norm': 3.752290964126587, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000298023224, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.11266787722706795, 'completion_length': 83.39286041259766, 'kl': 0.01446533203125, 'epoch': 0.17}

 34%|███▍      | 99/287 [1:02:33<2:14:35, 42.96s/it]WARNING 05-11 20:44:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:44:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 35%|███▍      | 100/287 [1:03:31<2:27:47, 47.42s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 13.377240180969238, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2857143878936768, 'reward_std': 0.2253357619047165, 'completion_length': 127.25000953674316, 'kl': 0.02191162109375, 'epoch': 0.17}

 35%|███▍      | 100/287 [1:03:31<2:27:47, 47.42s/it]WARNING 05-11 20:45:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:45:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:45:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:45:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:45:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:45:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:45:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:46:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:46:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:46:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:46:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:46:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:46:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:46:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 35%|███▌      | 101/287 [1:05:44<3:46:20, 73.01s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 2.2512741088867188, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571566939354, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.2321429252624512, 'reward_std': 0.2781319320201874, 'completion_length': 225.50000762939453, 'kl': 0.030029296875, 'epoch': 0.18}

 35%|███▌      | 101/287 [1:05:44<3:46:20, 73.01s/it]WARNING 05-11 20:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:47:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 36%|███▌      | 102/287 [1:06:40<3:29:55, 68.09s/it]
                                                     
{'loss': 0.0004, 'grad_norm': 1.7074276208877563, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000298023224, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.11266787722706795, 'completion_length': 100.16072082519531, 'kl': 0.010528564453125, 'epoch': 0.18}

 36%|███▌      | 102/287 [1:06:40<3:29:55, 68.09s/it]WARNING 05-11 20:48:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:48:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 36%|███▌      | 103/287 [1:07:16<2:59:03, 58.39s/it]
                                                     
{'loss': 0.0003, 'grad_norm': 1.1114968061447144, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107142984867096, 'rewards/format_reward': 1.0, 'reward': 1.410714328289032, 'reward_std': 0.07695359364151955, 'completion_length': 101.4464340209961, 'kl': 0.0080108642578125, 'epoch': 0.18}

 36%|███▌      | 103/287 [1:07:16<2:59:03, 58.39s/it]WARNING 05-11 20:49:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 36%|███▌      | 104/287 [1:07:41<2:27:01, 48.21s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 3.9221200942993164, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.14838216453790665, 'completion_length': 90.51786041259766, 'kl': 0.018310546875, 'epoch': 0.18}

 36%|███▌      | 104/287 [1:07:41<2:27:01, 48.21s/it]WARNING 05-11 20:49:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:49:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 37%|███▋      | 105/287 [1:08:42<2:38:17, 52.18s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 0.7034695744514465, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714477300644, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4107143878936768, 'reward_std': 0.0357142873108387, 'completion_length': 153.35715103149414, 'kl': 0.030059814453125, 'epoch': 0.18}

 37%|███▋      | 105/287 [1:08:42<2:38:17, 52.18s/it]WARNING 05-11 20:50:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 37%|███▋      | 106/287 [1:09:15<2:19:32, 46.26s/it]
                                                     
{'loss': 0.0166, 'grad_norm': 9.686467170715332, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428656578064, 'rewards/format_reward': 1.0, 'reward': 1.3571428656578064, 'reward_std': 0.0714285746216774, 'completion_length': 122.3035774230957, 'kl': 0.41650390625, 'epoch': 0.18}

 37%|███▋      | 106/287 [1:09:15<2:19:32, 46.26s/it]WARNING 05-11 20:50:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:50:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 37%|███▋      | 107/287 [1:09:46<2:05:45, 41.92s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 3.79227352142334, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 1.0, 'reward': 1.4642857909202576, 'reward_std': 0.1539071835577488, 'completion_length': 101.62500381469727, 'kl': 0.0167236328125, 'epoch': 0.19}

 37%|███▋      | 107/287 [1:09:46<2:05:45, 41.92s/it]WARNING 05-11 20:51:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:51:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 38%|███▊      | 108/287 [1:10:24<2:01:37, 40.77s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 0.26636454463005066, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714477300644, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.0, 'completion_length': 130.55358123779297, 'kl': 0.01788330078125, 'epoch': 0.19}

 38%|███▊      | 108/287 [1:10:24<2:01:37, 40.77s/it]WARNING 05-11 20:52:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:52:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 38%|███▊      | 109/287 [1:11:45<2:36:20, 52.70s/it]
                                                     
{'loss': 0.0008, 'grad_norm': 1.890513300895691, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.517857164144516, 'rewards/format_reward': 0.9464285969734192, 'reward': 1.4642857313156128, 'reward_std': 0.2253357470035553, 'completion_length': 270.96429443359375, 'kl': 0.02099609375, 'epoch': 0.19}

 38%|███▊      | 109/287 [1:11:45<2:36:20, 52.70s/it]WARNING 05-11 20:53:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 38%|███▊      | 110/287 [1:12:13<2:13:14, 45.17s/it]
                                                     
{'loss': 0.0004, 'grad_norm': 3.13028883934021, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.464285746216774, 'rewards/format_reward': 1.0, 'reward': 1.4642857909202576, 'reward_std': 0.0714285746216774, 'completion_length': 112.0714340209961, 'kl': 0.009796142578125, 'epoch': 0.19}

 38%|███▊      | 110/287 [1:12:13<2:13:14, 45.17s/it]WARNING 05-11 20:53:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:53:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 39%|███▊      | 111/287 [1:13:15<2:27:29, 50.28s/it]
                                                     
{'loss': 0.0005, 'grad_norm': 1.5611740350723267, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4464285969734192, 'reward_std': 0.1071428619325161, 'completion_length': 164.5714340209961, 'kl': 0.012786865234375, 'epoch': 0.19}

 39%|███▊      | 111/287 [1:13:15<2:27:29, 50.28s/it]WARNING 05-11 20:54:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:54:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 39%|███▉      | 112/287 [1:13:49<2:12:53, 45.57s/it]
                                                     
{'loss': 0.0005, 'grad_norm': 2.94376802444458, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3928571939468384, 'reward_std': 0.11266787722706795, 'completion_length': 128.6964340209961, 'kl': 0.013153076171875, 'epoch': 0.2}

 39%|███▉      | 112/287 [1:13:49<2:12:53, 45.57s/it]WARNING 05-11 20:55:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:55:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 39%|███▉      | 113/287 [1:14:19<1:58:22, 40.82s/it]
                                                     
{'loss': 0.0016, 'grad_norm': 3.8289358615875244, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857313156128, 'rewards/format_reward': 1.0, 'reward': 1.2142857909202576, 'reward_std': 0.1428571529686451, 'completion_length': 148.35714721679688, 'kl': 0.041015625, 'epoch': 0.2}

 39%|███▉      | 113/287 [1:14:19<1:58:22, 40.82s/it]WARNING 05-11 20:56:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 40%|███▉      | 114/287 [1:14:54<1:52:40, 39.08s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 2.7852230072021484, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714328289032, 'rewards/format_reward': 1.0, 'reward': 1.3035714626312256, 'reward_std': 0.14838216826319695, 'completion_length': 170.1428680419922, 'kl': 0.018341064453125, 'epoch': 0.2}

 40%|███▉      | 114/287 [1:14:54<1:52:40, 39.08s/it]WARNING 05-11 20:56:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:56:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 40%|████      | 115/287 [1:15:27<1:46:21, 37.10s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 1.928380012512207, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 1.0, 'reward': 1.321428656578064, 'reward_std': 0.0714285746216774, 'completion_length': 117.16072082519531, 'kl': 0.03704833984375, 'epoch': 0.2}

 40%|████      | 115/287 [1:15:27<1:46:21, 37.10s/it]WARNING 05-11 20:57:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:57:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 40%|████      | 116/287 [1:16:39<2:15:42, 47.62s/it]
                                                     
{'loss': 0.0019, 'grad_norm': 2.01279616355896, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3035714626312256, 'reward_std': 0.1896214708685875, 'completion_length': 183.6964340209961, 'kl': 0.0474853515625, 'epoch': 0.2}

 40%|████      | 116/287 [1:16:39<2:15:42, 47.62s/it]WARNING 05-11 20:58:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:58:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:58:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:58:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:58:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:58:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:58:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 41%|████      | 117/287 [1:17:51<2:36:04, 55.09s/it]
                                                     
{'loss': 0.0019, 'grad_norm': 0.28370100259780884, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714626312256, 'rewards/format_reward': 1.0, 'reward': 1.4285714626312256, 'reward_std': 0.0, 'completion_length': 141.50000762939453, 'kl': 0.0469970703125, 'epoch': 0.2}

 41%|████      | 117/287 [1:17:51<2:36:04, 55.09s/it]WARNING 05-11 20:59:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 20:59:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 41%|████      | 118/287 [1:18:17<2:10:31, 46.34s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 2.3735053539276123, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428805589676, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.07695358991622925, 'completion_length': 110.5714340209961, 'kl': 0.0185546875, 'epoch': 0.21}

 41%|████      | 118/287 [1:18:17<2:10:31, 46.34s/it]WARNING 05-11 21:00:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 41%|████▏     | 119/287 [1:18:51<1:59:02, 42.52s/it]
                                                     
{'loss': 0.0013, 'grad_norm': 1.866801142692566, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2500000149011612, 'rewards/format_reward': 1.0, 'reward': 1.2500000596046448, 'reward_std': 0.04123930633068085, 'completion_length': 97.17857551574707, 'kl': 0.0333251953125, 'epoch': 0.21}

 41%|████▏     | 119/287 [1:18:51<1:59:02, 42.52s/it]WARNING 05-11 21:00:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:00:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 42%|████▏     | 120/287 [1:19:57<2:17:48, 49.51s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 3.258563756942749, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857201397419, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.321428656578064, 'reward_std': 0.20117833465337753, 'completion_length': 162.7857208251953, 'kl': 0.0372314453125, 'epoch': 0.21}

 42%|████▏     | 120/287 [1:19:57<2:17:48, 49.51s/it]WARNING 05-11 21:01:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:01:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 42%|████▏     | 121/287 [1:20:31<2:04:03, 44.84s/it]
                                                     
{'loss': 0.0008, 'grad_norm': 1.3535175323486328, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 1.0, 'reward': 1.3035715222358704, 'reward_std': 0.0357142873108387, 'completion_length': 94.10714721679688, 'kl': 0.020751953125, 'epoch': 0.21}

 42%|████▏     | 121/287 [1:20:31<2:04:03, 44.84s/it]WARNING 05-11 21:02:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 43%|████▎     | 122/287 [1:20:59<1:49:44, 39.90s/it]
                                                     
{'loss': 0.0014, 'grad_norm': 2.7430074214935303, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.196428582072258, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.1071428619325161, 'completion_length': 73.94643211364746, 'kl': 0.0343017578125, 'epoch': 0.21}

 43%|████▎     | 122/287 [1:20:59<1:49:44, 39.90s/it]WARNING 05-11 21:02:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:02:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 43%|████▎     | 123/287 [1:21:58<2:04:45, 45.65s/it]
                                                     
{'loss': 0.0013, 'grad_norm': 3.881798267364502, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3571429252624512, 'reward_std': 0.2253357470035553, 'completion_length': 76.51786231994629, 'kl': 0.033203125, 'epoch': 0.21}

 43%|████▎     | 123/287 [1:21:58<2:04:45, 45.65s/it]WARNING 05-11 21:03:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:03:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 43%|████▎     | 124/287 [1:22:24<1:48:08, 39.81s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 2.2748911380767822, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3392857909202576, 'reward_std': 0.1071428619325161, 'completion_length': 64.44643211364746, 'kl': 0.02911376953125, 'epoch': 0.22}

 43%|████▎     | 124/287 [1:22:24<1:48:08, 39.81s/it]WARNING 05-11 21:04:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 44%|████▎     | 125/287 [1:22:52<1:37:46, 36.22s/it]
                                                     
{'loss': 0.0017, 'grad_norm': 2.8181405067443848, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 1.0, 'reward': 1.321428656578064, 'reward_std': 0.04123930633068085, 'completion_length': 76.83928680419922, 'kl': 0.04229736328125, 'epoch': 0.22}

 44%|████▎     | 125/287 [1:22:52<1:37:46, 36.22s/it]WARNING 05-11 21:04:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:04:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 44%|████▍     | 126/287 [1:23:16<1:27:23, 32.57s/it]
                                                     
{'loss': 0.0005, 'grad_norm': 3.5116655826568604, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.535714328289032, 'rewards/format_reward': 1.0, 'reward': 1.5357143878936768, 'reward_std': 0.18409645557403564, 'completion_length': 64.92857551574707, 'kl': 0.01251220703125, 'epoch': 0.22}

 44%|████▍     | 126/287 [1:23:16<1:27:23, 32.57s/it]WARNING 05-11 21:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 44%|████▍     | 127/287 [1:23:39<1:19:18, 29.74s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 1.8696483373641968, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1250000037252903, 'rewards/format_reward': 1.0, 'reward': 1.1250000596046448, 'reward_std': 0.1181928962469101, 'completion_length': 84.35714721679688, 'kl': 0.03857421875, 'epoch': 0.22}

 44%|████▍     | 127/287 [1:23:39<1:19:18, 29.74s/it]WARNING 05-11 21:05:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 45%|████▍     | 128/287 [1:24:00<1:11:58, 27.16s/it]
                                                     
{'loss': 0.0021, 'grad_norm': 2.146217107772827, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857313156128, 'rewards/format_reward': 1.0, 'reward': 1.2142857909202576, 'reward_std': 0.11266787722706795, 'completion_length': 44.33928680419922, 'kl': 0.05169677734375, 'epoch': 0.22}

 45%|████▍     | 128/287 [1:24:00<1:11:58, 27.16s/it]WARNING 05-11 21:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:05:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 45%|████▍     | 129/287 [1:24:28<1:12:06, 27.39s/it]
                                                     
{'loss': 0.0026, 'grad_norm': 3.347040891647339, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857387661934, 'rewards/format_reward': 1.0, 'reward': 1.3392857909202576, 'reward_std': 0.15943221747875214, 'completion_length': 82.62500381469727, 'kl': 0.06396484375, 'epoch': 0.22}

 45%|████▍     | 129/287 [1:24:28<1:12:06, 27.39s/it]WARNING 05-11 21:06:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 45%|████▌     | 130/287 [1:24:59<1:13:57, 28.26s/it]
                                                     
{'loss': 0.0004, 'grad_norm': 4.6205220222473145, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5178571790456772, 'rewards/format_reward': 1.0, 'reward': 1.5178572535514832, 'reward_std': 0.1071428619325161, 'completion_length': 53.42857360839844, 'kl': 0.0107421875, 'epoch': 0.23}

 45%|████▌     | 130/287 [1:24:59<1:13:57, 28.26s/it]WARNING 05-11 21:06:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:06:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 46%|████▌     | 131/287 [1:25:20<1:08:15, 26.25s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 2.9447522163391113, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2500000149011612, 'rewards/format_reward': 1.0, 'reward': 1.2500000596046448, 'reward_std': 0.0714285746216774, 'completion_length': 56.83928871154785, 'kl': 0.037841796875, 'epoch': 0.23}

 46%|████▌     | 131/287 [1:25:20<1:08:15, 26.25s/it]WARNING 05-11 21:07:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 46%|████▌     | 132/287 [1:25:44<1:06:22, 25.69s/it]
                                                     
{'loss': 0.0006, 'grad_norm': 1.954282283782959, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.0357142873108387, 'completion_length': 51.35714340209961, 'kl': 0.014892578125, 'epoch': 0.23}

 46%|████▌     | 132/287 [1:25:44<1:06:22, 25.69s/it]WARNING 05-11 21:07:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 46%|████▋     | 133/287 [1:26:03<1:00:10, 23.44s/it]
                                                     
{'loss': 0.0011, 'grad_norm': 3.2583563327789307, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857201397419, 'rewards/format_reward': 1.0, 'reward': 1.3392857909202576, 'reward_std': 0.1896214634180069, 'completion_length': 43.785715103149414, 'kl': 0.02728271484375, 'epoch': 0.23}

 46%|████▋     | 133/287 [1:26:03<1:00:10, 23.44s/it]WARNING 05-11 21:07:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:07:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 47%|████▋     | 134/287 [1:26:28<1:01:32, 24.13s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 2.019145965576172, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.1181928962469101, 'completion_length': 40.73214530944824, 'kl': 0.03070068359375, 'epoch': 0.23}

 47%|████▋     | 134/287 [1:26:28<1:01:32, 24.13s/it]WARNING 05-11 21:08:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 47%|████▋     | 135/287 [1:27:15<1:18:28, 30.98s/it]
                                                     
{'loss': 0.0011, 'grad_norm': 3.1185953617095947, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 1.0, 'reward': 1.4642857909202576, 'reward_std': 0.11266787722706795, 'completion_length': 88.1785774230957, 'kl': 0.0279541015625, 'epoch': 0.24}

 47%|████▋     | 135/287 [1:27:15<1:18:28, 30.98s/it]WARNING 05-11 21:08:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:08:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 47%|████▋     | 136/287 [1:27:45<1:16:54, 30.56s/it]
                                                     
{'loss': 0.0008, 'grad_norm': 2.3059451580047607, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857313156128, 'reward_std': 0.1071428619325161, 'completion_length': 86.4464340209961, 'kl': 0.021240234375, 'epoch': 0.24}

 47%|████▋     | 136/287 [1:27:45<1:16:54, 30.56s/it]WARNING 05-11 21:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 48%|████▊     | 137/287 [1:28:06<1:09:26, 27.78s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 2.1635305881500244, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857387661934, 'rewards/format_reward': 1.0, 'reward': 1.3392857909202576, 'reward_std': 0.0357142873108387, 'completion_length': 38.73214340209961, 'kl': 0.0386962890625, 'epoch': 0.24}

 48%|████▊     | 137/287 [1:28:06<1:09:26, 27.78s/it]WARNING 05-11 21:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 48%|████▊     | 138/287 [1:28:29<1:04:54, 26.14s/it]
                                                     
{'loss': 0.001, 'grad_norm': 2.8988265991210938, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714626312256, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.1428571529686451, 'completion_length': 38.857144355773926, 'kl': 0.02593994140625, 'epoch': 0.24}

 48%|████▊     | 138/287 [1:28:29<1:04:54, 26.14s/it]WARNING 05-11 21:10:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 48%|████▊     | 139/287 [1:28:57<1:06:00, 26.76s/it]
                                                     
{'loss': 0.0011, 'grad_norm': 1.5397194623947144, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.160714291036129, 'rewards/format_reward': 1.0, 'reward': 1.160714328289032, 'reward_std': 0.0357142873108387, 'completion_length': 80.26786041259766, 'kl': 0.02783203125, 'epoch': 0.24}

 48%|████▊     | 139/287 [1:28:57<1:06:00, 26.76s/it]WARNING 05-11 21:10:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:10:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 49%|████▉     | 140/287 [1:29:29<1:09:18, 28.29s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 2.166212558746338, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428656578064, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.07695359364151955, 'completion_length': 64.46428871154785, 'kl': 0.03082275390625, 'epoch': 0.24}

 49%|████▉     | 140/287 [1:29:29<1:09:18, 28.29s/it]WARNING 05-11 21:11:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:11:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 49%|████▉     | 141/287 [1:30:27<1:30:52, 37.35s/it]
                                                     
{'loss': 0.006, 'grad_norm': 5.472555160522461, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.1071428619325161, 'completion_length': 88.37500381469727, 'kl': 0.14935302734375, 'epoch': 0.25}

 49%|████▉     | 141/287 [1:30:27<1:30:52, 37.35s/it]WARNING 05-11 21:12:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 49%|████▉     | 142/287 [1:31:39<1:55:00, 47.59s/it]
                                                     
{'loss': 0.0029, 'grad_norm': 3.641603708267212, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428656578064, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3392857313156128, 'reward_std': 0.2500000149011612, 'completion_length': 149.0357208251953, 'kl': 0.07275390625, 'epoch': 0.25}

 49%|████▉     | 142/287 [1:31:39<1:55:00, 47.59s/it]WARNING 05-11 21:13:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:13:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:13:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:13:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:13:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:13:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:13:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 50%|████▉     | 143/287 [1:32:36<2:01:04, 50.45s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 2.068432092666626, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000149011612, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4821429252624512, 'reward_std': 0.1071428619325161, 'completion_length': 93.53571605682373, 'kl': 0.0179443359375, 'epoch': 0.25}

 50%|████▉     | 143/287 [1:32:36<2:01:04, 50.45s/it]WARNING 05-11 21:14:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:14:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 50%|█████     | 144/287 [1:33:32<2:04:44, 52.34s/it]
                                                     
{'loss': 0.0013, 'grad_norm': 3.1934571266174316, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3392857909202576, 'reward_std': 0.1896214783191681, 'completion_length': 76.91071701049805, 'kl': 0.032135009765625, 'epoch': 0.25}

 50%|█████     | 144/287 [1:33:32<2:04:44, 52.34s/it]WARNING 05-11 21:15:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 51%|█████     | 145/287 [1:33:58<1:44:48, 44.29s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 4.360013008117676, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.1785714402794838, 'completion_length': 63.48214530944824, 'kl': 0.0228271484375, 'epoch': 0.25}

 51%|█████     | 145/287 [1:33:58<1:44:48, 44.29s/it]WARNING 05-11 21:15:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:15:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 51%|█████     | 146/287 [1:34:35<1:38:45, 42.02s/it]
                                                     
{'loss': 0.001, 'grad_norm': 2.8741180896759033, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 1.0, 'reward': 1.3035715222358704, 'reward_std': 0.1071428619325161, 'completion_length': 72.35714721679688, 'kl': 0.02532958984375, 'epoch': 0.25}

 51%|█████     | 146/287 [1:34:35<1:38:45, 42.02s/it]WARNING 05-11 21:16:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:16:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 51%|█████     | 147/287 [1:35:17<1:38:19, 42.14s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 1.8826771974563599, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3928571939468384, 'reward_std': 0.1539071798324585, 'completion_length': 110.25000381469727, 'kl': 0.02978515625, 'epoch': 0.26}

 51%|█████     | 147/287 [1:35:17<1:38:19, 42.14s/it]WARNING 05-11 21:17:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 52%|█████▏    | 148/287 [1:35:50<1:30:56, 39.25s/it]
                                                     
{'loss': 0.0019, 'grad_norm': 3.6265451908111572, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714328289032, 'rewards/format_reward': 1.0, 'reward': 1.3035714626312256, 'reward_std': 0.1896214708685875, 'completion_length': 71.26786041259766, 'kl': 0.048583984375, 'epoch': 0.26}

 52%|█████▏    | 148/287 [1:35:50<1:30:56, 39.25s/it]WARNING 05-11 21:17:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 52%|█████▏    | 149/287 [1:36:49<1:43:55, 45.19s/it]
                                                     
{'loss': 0.0004, 'grad_norm': 0.5442935824394226, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000298023224, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.3392857909202576, 'reward_std': 0.07695359364151955, 'completion_length': 97.85714626312256, 'kl': 0.010833740234375, 'epoch': 0.26}

 52%|█████▏    | 149/287 [1:36:49<1:43:55, 45.19s/it]WARNING 05-11 21:18:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 52%|█████▏    | 150/287 [1:37:16<1:31:04, 39.88s/it]
                                                     
{'loss': 0.001, 'grad_norm': 1.9305377006530762, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857313156128, 'rewards/format_reward': 1.0, 'reward': 1.2142857313156128, 'reward_std': 0.18409645557403564, 'completion_length': 83.66072082519531, 'kl': 0.0252685546875, 'epoch': 0.26}

 52%|█████▏    | 150/287 [1:37:16<1:31:04, 39.88s/it]WARNING 05-11 21:19:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 53%|█████▎    | 151/287 [1:37:35<1:16:17, 33.66s/it]
                                                     
{'loss': 0.0005, 'grad_norm': 2.0649831295013428, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107143133878708, 'rewards/format_reward': 1.0, 'reward': 1.410714328289032, 'reward_std': 0.0357142873108387, 'completion_length': 37.58928680419922, 'kl': 0.012451171875, 'epoch': 0.26}

 53%|█████▎    | 151/287 [1:37:35<1:16:17, 33.66s/it]WARNING 05-11 21:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 53%|█████▎    | 152/287 [1:38:05<1:12:44, 32.33s/it]
                                                     
{'loss': 0.0011, 'grad_norm': 1.8178359270095825, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857313156128, 'rewards/format_reward': 1.0, 'reward': 1.2142857909202576, 'reward_std': 0.11266787722706795, 'completion_length': 101.19643592834473, 'kl': 0.0281219482421875, 'epoch': 0.26}

 53%|█████▎    | 152/287 [1:38:05<1:12:44, 32.33s/it]WARNING 05-11 21:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 53%|█████▎    | 153/287 [1:39:05<1:31:19, 40.89s/it]
                                                     
{'loss': 0.001, 'grad_norm': 2.5066514015197754, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.1896214671432972, 'completion_length': 128.00000381469727, 'kl': 0.02520751953125, 'epoch': 0.27}

 53%|█████▎    | 153/287 [1:39:05<1:31:19, 40.89s/it]WARNING 05-11 21:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:20:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 54%|█████▎    | 154/287 [1:39:37<1:24:29, 38.11s/it]
                                                     
{'loss': 0.0016, 'grad_norm': 3.425482988357544, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.464285746216774, 'rewards/format_reward': 1.0, 'reward': 1.4642857909202576, 'reward_std': 0.1539071872830391, 'completion_length': 85.98214530944824, 'kl': 0.0396728515625, 'epoch': 0.27}

 54%|█████▎    | 154/287 [1:39:37<1:24:29, 38.11s/it]WARNING 05-11 21:21:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 54%|█████▍    | 155/287 [1:40:15<1:23:35, 38.00s/it]
                                                     
{'loss': 0.001, 'grad_norm': 2.5160961151123047, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3928571492433548, 'rewards/format_reward': 1.0, 'reward': 1.3928572535514832, 'reward_std': 0.04123930633068085, 'completion_length': 115.71429061889648, 'kl': 0.023834228515625, 'epoch': 0.27}

 54%|█████▍    | 155/287 [1:40:15<1:23:35, 38.00s/it]WARNING 05-11 21:21:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:21:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 54%|█████▍    | 156/287 [1:40:43<1:16:32, 35.06s/it]
                                                     
{'loss': 0.0104, 'grad_norm': 10.696795463562012, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714328289032, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.18409645557403564, 'completion_length': 80.55357551574707, 'kl': 0.25927734375, 'epoch': 0.27}

 54%|█████▍    | 156/287 [1:40:43<1:16:32, 35.06s/it]WARNING 05-11 21:22:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:22:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 55%|█████▍    | 157/287 [1:41:17<1:15:16, 34.74s/it]
                                                     
{'loss': 0.0021, 'grad_norm': 3.024477481842041, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.6785714626312256, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.660714328289032, 'reward_std': 0.1896214708685875, 'completion_length': 86.33928871154785, 'kl': 0.052734375, 'epoch': 0.27}

 55%|█████▍    | 157/287 [1:41:17<1:15:16, 34.74s/it]WARNING 05-11 21:23:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:23:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 55%|█████▌    | 158/287 [1:42:16<1:30:11, 41.95s/it]
                                                     
{'loss': 0.0018, 'grad_norm': 2.745347738265991, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.267857164144516, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2500000596046448, 'reward_std': 0.17553051561117172, 'completion_length': 103.62500762939453, 'kl': 0.04443359375, 'epoch': 0.28}

 55%|█████▌    | 158/287 [1:42:16<1:30:11, 41.95s/it]WARNING 05-11 21:24:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:24:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 55%|█████▌    | 159/287 [1:43:52<2:04:23, 58.31s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 1.636460304260254, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5892857313156128, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.5535715222358704, 'reward_std': 0.1071428619325161, 'completion_length': 167.83929443359375, 'kl': 0.03692626953125, 'epoch': 0.28}

 55%|█████▌    | 159/287 [1:43:52<2:04:23, 58.31s/it]WARNING 05-11 21:25:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 56%|█████▌    | 160/287 [1:44:29<1:50:02, 51.99s/it]
                                                     
{'loss': 0.0019, 'grad_norm': 2.992979049682617, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428656578064, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.07695359364151955, 'completion_length': 88.21429061889648, 'kl': 0.0478515625, 'epoch': 0.28}

 56%|█████▌    | 160/287 [1:44:29<1:50:02, 51.99s/it]WARNING 05-11 21:26:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 56%|█████▌    | 161/287 [1:45:00<1:35:33, 45.51s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 3.4094440937042236, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.13981622830033302, 'completion_length': 91.78571891784668, 'kl': 0.02984619140625, 'epoch': 0.28}

 56%|█████▌    | 161/287 [1:45:00<1:35:33, 45.51s/it]WARNING 05-11 21:26:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:26:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 56%|█████▋    | 162/287 [1:46:05<1:47:09, 51.43s/it]
                                                     
{'loss': 0.0014, 'grad_norm': 1.9827454090118408, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5892857313156128, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.571428656578064, 'reward_std': 0.11266788095235825, 'completion_length': 142.4107208251953, 'kl': 0.0338134765625, 'epoch': 0.28}

 56%|█████▋    | 162/287 [1:46:05<1:47:09, 51.43s/it]WARNING 05-11 21:27:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:27:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 57%|█████▋    | 163/287 [1:46:23<1:25:23, 41.32s/it]
                                                     
{'loss': 0.0013, 'grad_norm': 2.508366584777832, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428656578064, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.1071428619325161, 'completion_length': 64.25000381469727, 'kl': 0.0325927734375, 'epoch': 0.28}

 57%|█████▋    | 163/287 [1:46:23<1:25:23, 41.32s/it]WARNING 05-11 21:28:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 57%|█████▋    | 164/287 [1:46:58<1:20:52, 39.45s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 1.8989440202713013, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1250000074505806, 'rewards/format_reward': 1.0, 'reward': 1.1250000596046448, 'reward_std': 0.1181928999722004, 'completion_length': 69.16071701049805, 'kl': 0.03753662109375, 'epoch': 0.29}

 57%|█████▋    | 164/287 [1:46:58<1:20:52, 39.45s/it]WARNING 05-11 21:28:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 57%|█████▋    | 165/287 [1:47:24<1:12:10, 35.50s/it]
                                                     
{'loss': 0.0023, 'grad_norm': 0.6612725257873535, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857909202576, 'reward_std': 0.0357142873108387, 'completion_length': 73.41071891784668, 'kl': 0.056884765625, 'epoch': 0.29}

 57%|█████▋    | 165/287 [1:47:24<1:12:10, 35.50s/it]WARNING 05-11 21:29:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 58%|█████▊    | 166/287 [1:47:48<1:04:32, 32.01s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 1.9273655414581299, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428954601288, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.0357142873108387, 'completion_length': 78.28571891784668, 'kl': 0.0369873046875, 'epoch': 0.29}

 58%|█████▊    | 166/287 [1:47:48<1:04:32, 32.01s/it]WARNING 05-11 21:29:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:29:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 58%|█████▊    | 167/287 [1:48:34<1:12:18, 36.15s/it]
                                                     
{'loss': 0.0029, 'grad_norm': 2.645944595336914, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714328289032, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.11266788095235825, 'completion_length': 113.0, 'kl': 0.0712890625, 'epoch': 0.29}

 58%|█████▊    | 167/287 [1:48:34<1:12:18, 36.15s/it]WARNING 05-11 21:30:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:30:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:30:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:30:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:30:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:30:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:30:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 59%|█████▊    | 168/287 [1:50:06<1:44:46, 52.83s/it]
                                                     
{'loss': 0.0017, 'grad_norm': 4.674932479858398, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5714285969734192, 'rewards/format_reward': 0.9464285969734192, 'reward': 1.5178572535514832, 'reward_std': 0.2500000149011612, 'completion_length': 180.05358123779297, 'kl': 0.04229736328125, 'epoch': 0.29}

 59%|█████▊    | 168/287 [1:50:06<1:44:46, 52.83s/it]WARNING 05-11 21:31:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:31:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 59%|█████▉    | 169/287 [1:50:25<1:24:09, 42.79s/it]
                                                     
{'loss': 0.0013, 'grad_norm': 0.8782339096069336, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.446428582072258, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.1071428619325161, 'completion_length': 83.42857360839844, 'kl': 0.03192138671875, 'epoch': 0.29}

 59%|█████▉    | 169/287 [1:50:25<1:24:09, 42.79s/it]WARNING 05-11 21:32:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 59%|█████▉    | 170/287 [1:50:57<1:17:15, 39.62s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 4.1768798828125, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857313156128, 'reward_std': 0.1896214783191681, 'completion_length': 74.44643211364746, 'kl': 0.0213623046875, 'epoch': 0.3}

 59%|█████▉    | 170/287 [1:50:57<1:17:15, 39.62s/it]WARNING 05-11 21:32:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:32:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 60%|█████▉    | 171/287 [1:51:26<1:10:30, 36.47s/it]
                                                     
{'loss': 0.0013, 'grad_norm': 2.387350559234619, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428656578064, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.11266788095235825, 'completion_length': 96.91071701049805, 'kl': 0.03302001953125, 'epoch': 0.3}

 60%|█████▉    | 171/287 [1:51:26<1:10:30, 36.47s/it]WARNING 05-11 21:33:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 60%|█████▉    | 172/287 [1:51:54<1:04:45, 33.78s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 1.6566195487976074, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857164144516, 'rewards/format_reward': 1.0, 'reward': 1.2142857313156128, 'reward_std': 0.11266787722706795, 'completion_length': 52.53571701049805, 'kl': 0.01715087890625, 'epoch': 0.3}

 60%|█████▉    | 172/287 [1:51:54<1:04:45, 33.78s/it]WARNING 05-11 21:33:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:33:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 60%|██████    | 173/287 [1:52:51<1:17:34, 40.83s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 0.38895443081855774, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.446428582072258, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4285714626312256, 'reward_std': 0.0714285746216774, 'completion_length': 87.28571891784668, 'kl': 0.021942138671875, 'epoch': 0.3}

 60%|██████    | 173/287 [1:52:51<1:17:34, 40.83s/it]WARNING 05-11 21:34:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:34:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 61%|██████    | 174/287 [1:53:52<1:28:10, 46.82s/it]
                                                     
{'loss': 0.0016, 'grad_norm': 1.7496508359909058, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857164144516, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3214285969734192, 'reward_std': 0.18409644439816475, 'completion_length': 117.71428680419922, 'kl': 0.0400390625, 'epoch': 0.3}

 61%|██████    | 174/287 [1:53:52<1:28:10, 46.82s/it]WARNING 05-11 21:35:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 61%|██████    | 175/287 [1:54:24<1:19:04, 42.36s/it]
                                                     
{'loss': 0.0014, 'grad_norm': 3.7652010917663574, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428954601288, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.1896214783191681, 'completion_length': 64.80357360839844, 'kl': 0.035858154296875, 'epoch': 0.3}

 61%|██████    | 175/287 [1:54:24<1:19:04, 42.36s/it]WARNING 05-11 21:36:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 61%|██████▏   | 176/287 [1:54:48<1:08:31, 37.04s/it]
                                                     
{'loss': 0.0021, 'grad_norm': 2.6904120445251465, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.535714328289032, 'rewards/format_reward': 1.0, 'reward': 1.535714328289032, 'reward_std': 0.0714285746216774, 'completion_length': 42.83928871154785, 'kl': 0.0521240234375, 'epoch': 0.31}

 61%|██████▏   | 176/287 [1:54:49<1:08:31, 37.04s/it]WARNING 05-11 21:36:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 62%|██████▏   | 177/287 [1:55:11<59:53, 32.67s/it]  
                                                   
{'loss': 0.001, 'grad_norm': 0.48939013481140137, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 1.0, 'reward': 1.3035714626312256, 'reward_std': 0.0357142873108387, 'completion_length': 47.57143020629883, 'kl': 0.02618408203125, 'epoch': 0.31}

 62%|██████▏   | 177/287 [1:55:11<59:53, 32.67s/it]WARNING 05-11 21:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:36:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 62%|██████▏   | 178/287 [1:56:04<1:10:32, 38.83s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 1.4582267999649048, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.535714328289032, 'rewards/format_reward': 1.0, 'reward': 1.5357143878936768, 'reward_std': 0.1428571529686451, 'completion_length': 121.46429061889648, 'kl': 0.0306396484375, 'epoch': 0.31}

 62%|██████▏   | 178/287 [1:56:04<1:10:32, 38.83s/it]WARNING 05-11 21:37:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:37:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 62%|██████▏   | 179/287 [1:56:27<1:01:08, 33.97s/it]
                                                     
{'loss': 0.0032, 'grad_norm': 3.9010655879974365, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3928571939468384, 'reward_std': 0.18409644439816475, 'completion_length': 35.57143020629883, 'kl': 0.080078125, 'epoch': 0.31}

 62%|██████▏   | 179/287 [1:56:27<1:01:08, 33.97s/it]WARNING 05-11 21:38:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 63%|██████▎   | 180/287 [1:57:08<1:04:32, 36.19s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 1.6214792728424072, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 1.0, 'reward': 1.321428656578064, 'reward_std': 0.04123930633068085, 'completion_length': 75.35714721679688, 'kl': 0.023193359375, 'epoch': 0.31}

 63%|██████▎   | 180/287 [1:57:08<1:04:32, 36.19s/it]WARNING 05-11 21:38:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:38:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 63%|██████▎   | 181/287 [1:57:32<57:38, 32.63s/it]  
                                                   
{'loss': 0.0022, 'grad_norm': 3.284914493560791, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428656578064, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.1428571492433548, 'completion_length': 78.71428680419922, 'kl': 0.05523681640625, 'epoch': 0.32}

 63%|██████▎   | 181/287 [1:57:32<57:38, 32.63s/it]WARNING 05-11 21:39:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 63%|██████▎   | 182/287 [1:57:59<54:05, 30.91s/it]
                                                   
{'loss': 0.0042, 'grad_norm': 4.006487846374512, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.375, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.1896214634180069, 'completion_length': 58.41071891784668, 'kl': 0.104736328125, 'epoch': 0.32}

 63%|██████▎   | 182/287 [1:57:59<54:05, 30.91s/it]WARNING 05-11 21:39:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:39:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 64%|██████▍   | 183/287 [1:59:02<1:10:11, 40.50s/it]
                                                     
{'loss': 0.0035, 'grad_norm': 4.7774529457092285, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3928571492433548, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3750000596046448, 'reward_std': 0.23086076974868774, 'completion_length': 90.73214340209961, 'kl': 0.0869140625, 'epoch': 0.32}

 64%|██████▍   | 183/287 [1:59:02<1:10:11, 40.50s/it]WARNING 05-11 21:40:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:40:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:40:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:40:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:40:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:40:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:40:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 64%|██████▍   | 184/287 [1:59:32<1:03:55, 37.24s/it]
                                                     
{'loss': 0.0007, 'grad_norm': 2.5579843521118164, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857313156128, 'reward_std': 0.1181928962469101, 'completion_length': 84.4464340209961, 'kl': 0.01861572265625, 'epoch': 0.32}

 64%|██████▍   | 184/287 [1:59:32<1:03:55, 37.24s/it]WARNING 05-11 21:41:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:41:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 64%|██████▍   | 185/287 [2:00:27<1:12:35, 42.70s/it]
                                                     
{'loss': 0.0059, 'grad_norm': 6.381178855895996, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000298023224, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3571429252624512, 'reward_std': 0.17553051188588142, 'completion_length': 85.0892915725708, 'kl': 0.14697265625, 'epoch': 0.32}

 64%|██████▍   | 185/287 [2:00:27<1:12:35, 42.70s/it]WARNING 05-11 21:42:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 65%|██████▍   | 186/287 [2:01:07<1:10:17, 41.76s/it]
                                                     
{'loss': 0.0018, 'grad_norm': 2.0167815685272217, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428954601288, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.1071428619325161, 'completion_length': 83.10714530944824, 'kl': 0.04510498046875, 'epoch': 0.32}

 65%|██████▍   | 186/287 [2:01:07<1:10:17, 41.76s/it]WARNING 05-11 21:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:42:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 65%|██████▌   | 187/287 [2:01:43<1:06:31, 39.92s/it]
                                                     
{'loss': 0.0142, 'grad_norm': 5.1039533615112305, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107142984867096, 'rewards/format_reward': 1.0, 'reward': 1.4107143878936768, 'reward_std': 0.0357142873108387, 'completion_length': 56.94643020629883, 'kl': 0.357666015625, 'epoch': 0.33}

 65%|██████▌   | 187/287 [2:01:43<1:06:31, 39.92s/it]WARNING 05-11 21:43:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 66%|██████▌   | 188/287 [2:02:06<57:39, 34.94s/it]  
                                                   
{'loss': 0.0011, 'grad_norm': 3.473409414291382, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285857975483, 'rewards/format_reward': 1.0, 'reward': 1.196428656578064, 'reward_std': 0.14838217198848724, 'completion_length': 80.30357551574707, 'kl': 0.0269775390625, 'epoch': 0.33}

 66%|██████▌   | 188/287 [2:02:06<57:39, 34.94s/it]WARNING 05-11 21:43:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:43:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 66%|██████▌   | 189/287 [2:03:07<1:09:44, 42.70s/it]
                                                     
{'loss': 0.0015, 'grad_norm': 2.9016196727752686, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.375, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3571429252624512, 'reward_std': 0.1539071872830391, 'completion_length': 118.9464340209961, 'kl': 0.0382080078125, 'epoch': 0.33}

 66%|██████▌   | 189/287 [2:03:07<1:09:44, 42.70s/it]WARNING 05-11 21:44:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:44:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 66%|██████▌   | 190/287 [2:03:49<1:08:53, 42.61s/it]
                                                     
{'loss': 0.0022, 'grad_norm': 0.8981659412384033, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 1.0, 'reward': 1.3214285969734192, 'reward_std': 0.0714285746216774, 'completion_length': 95.7500057220459, 'kl': 0.0546875, 'epoch': 0.33}

 66%|██████▌   | 190/287 [2:03:49<1:08:53, 42.61s/it]WARNING 05-11 21:45:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:45:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 67%|██████▋   | 191/287 [2:04:50<1:16:49, 48.01s/it]
                                                     
{'loss': 0.001, 'grad_norm': 4.527611255645752, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3214285969734192, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3035714626312256, 'reward_std': 0.21981074661016464, 'completion_length': 129.6785774230957, 'kl': 0.02496337890625, 'epoch': 0.33}

 67%|██████▋   | 191/287 [2:04:50<1:16:49, 48.01s/it]WARNING 05-11 21:46:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:46:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:46:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:46:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:46:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:46:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:46:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 67%|██████▋   | 192/287 [2:05:44<1:19:00, 49.90s/it]
                                                     
{'loss': 0.0011, 'grad_norm': 3.2762503623962402, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.517857164144516, 'rewards/format_reward': 1.0, 'reward': 1.5178571939468384, 'reward_std': 0.1896214634180069, 'completion_length': 104.01786422729492, 'kl': 0.02789306640625, 'epoch': 0.33}

 67%|██████▋   | 192/287 [2:05:44<1:19:00, 49.90s/it]WARNING 05-11 21:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:47:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 67%|██████▋   | 193/287 [2:06:44<1:23:05, 53.04s/it]
                                                     
{'loss': 0.0011, 'grad_norm': 0.3989364504814148, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714477300644, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4107143878936768, 'reward_std': 0.1071428656578064, 'completion_length': 116.10714912414551, 'kl': 0.027191162109375, 'epoch': 0.34}

 67%|██████▋   | 193/287 [2:06:44<1:23:05, 53.04s/it]WARNING 05-11 21:48:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:48:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 68%|██████▊   | 194/287 [2:07:42<1:24:35, 54.57s/it]
                                                     
{'loss': 0.0026, 'grad_norm': 3.07249116897583, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428805589676, 'rewards/format_reward': 0.9464285969734192, 'reward': 1.4285715222358704, 'reward_std': 0.2142857238650322, 'completion_length': 106.44643020629883, 'kl': 0.06402587890625, 'epoch': 0.34}

 68%|██████▊   | 194/287 [2:07:42<1:24:35, 54.57s/it]WARNING 05-11 21:49:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:49:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 68%|██████▊   | 195/287 [2:08:21<1:16:10, 49.68s/it]
                                                     
{'loss': 0.0016, 'grad_norm': 2.6204211711883545, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428805589676, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.14838216453790665, 'completion_length': 125.30357360839844, 'kl': 0.0406494140625, 'epoch': 0.34}

 68%|██████▊   | 195/287 [2:08:21<1:16:10, 49.68s/it]WARNING 05-11 21:50:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:50:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 68%|██████▊   | 196/287 [2:09:57<1:36:28, 63.60s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 2.4586830139160156, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.160714328289032, 'reward_std': 0.14838216826319695, 'completion_length': 204.33929443359375, 'kl': 0.022979736328125, 'epoch': 0.34}

 68%|██████▊   | 196/287 [2:09:57<1:36:28, 63.60s/it]WARNING 05-11 21:51:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:51:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 69%|██████▊   | 197/287 [2:10:24<1:19:09, 52.77s/it]
                                                     
{'loss': 0.0012, 'grad_norm': 2.2106120586395264, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.6071428954601288, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.5892857909202576, 'reward_std': 0.1071428619325161, 'completion_length': 107.1964340209961, 'kl': 0.02947998046875, 'epoch': 0.34}

 69%|██████▊   | 197/287 [2:10:24<1:19:09, 52.77s/it]WARNING 05-11 21:52:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 69%|██████▉   | 198/287 [2:10:48<1:05:31, 44.18s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 2.3767316341400146, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.6607142984867096, 'rewards/format_reward': 1.0, 'reward': 1.6607143878936768, 'reward_std': 0.14838216453790665, 'completion_length': 74.0714340209961, 'kl': 0.0233154296875, 'epoch': 0.34}

 69%|██████▉   | 198/287 [2:10:48<1:05:31, 44.18s/it]WARNING 05-11 21:52:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:33 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:52:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 69%|██████▉   | 199/287 [2:11:43<1:09:25, 47.33s/it]
                                                     
{'loss': 0.001, 'grad_norm': 2.5186073780059814, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5357142984867096, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.5178572535514832, 'reward_std': 0.07695358991622925, 'completion_length': 86.69643211364746, 'kl': 0.02484130859375, 'epoch': 0.35}

 69%|██████▉   | 199/287 [2:11:43<1:09:25, 47.33s/it]WARNING 05-11 21:53:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:53:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 70%|██████▉   | 200/287 [2:12:10<59:38, 41.13s/it]  
                                                   
{'loss': 0.002, 'grad_norm': 2.4405910968780518, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.446428582072258, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.1785714402794838, 'completion_length': 64.44643211364746, 'kl': 0.0489501953125, 'epoch': 0.35}

 70%|██████▉   | 200/287 [2:12:10<59:38, 41.13s/it]WARNING 05-11 21:54:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:54:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 70%|███████   | 201/287 [2:13:19<1:10:55, 49.48s/it]
                                                     
{'loss': 0.0009, 'grad_norm': 0.9855377674102783, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.0357142873108387, 'completion_length': 93.01786041259766, 'kl': 0.021942138671875, 'epoch': 0.35}

 70%|███████   | 201/287 [2:13:19<1:10:55, 49.48s/it]WARNING 05-11 21:55:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:55:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 70%|███████   | 202/287 [2:14:28<1:18:30, 55.42s/it]
                                                     
{'loss': 0.0013, 'grad_norm': 3.432076930999756, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.285714328289032, 'reward_std': 0.2253357619047165, 'completion_length': 172.66072463989258, 'kl': 0.03289794921875, 'epoch': 0.35}

 70%|███████   | 202/287 [2:14:28<1:18:30, 55.42s/it]WARNING 05-11 21:56:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:56:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 71%|███████   | 203/287 [2:15:26<1:18:43, 56.24s/it]
                                                     
{'loss': 0.0031, 'grad_norm': 2.278350591659546, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107142984867096, 'rewards/format_reward': 1.0, 'reward': 1.4107143878936768, 'reward_std': 0.14838217198848724, 'completion_length': 136.33929443359375, 'kl': 0.0782470703125, 'epoch': 0.35}

 71%|███████   | 203/287 [2:15:26<1:18:43, 56.24s/it]WARNING 05-11 21:57:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 71%|███████   | 204/287 [2:15:53<1:05:23, 47.27s/it]
                                                     
{'loss': 0.0023, 'grad_norm': 1.4343416690826416, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 1.0, 'reward': 1.4464285969734192, 'reward_std': 0.07695358991622925, 'completion_length': 108.37500762939453, 'kl': 0.056396484375, 'epoch': 0.36}

 71%|███████   | 204/287 [2:15:53<1:05:23, 47.27s/it]WARNING 05-11 21:57:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:57:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 71%|███████▏  | 205/287 [2:16:54<1:10:31, 51.60s/it]
                                                     
{'loss': 0.0014, 'grad_norm': 0.8859798908233643, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.6964285969734192, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.6785715222358704, 'reward_std': 0.18409644439816475, 'completion_length': 145.7857208251953, 'kl': 0.03472900390625, 'epoch': 0.36}

 71%|███████▏  | 205/287 [2:16:54<1:10:31, 51.60s/it]WARNING 05-11 21:58:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:58:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:58:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:58:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:58:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:58:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:58:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 72%|███████▏  | 206/287 [2:17:38<1:06:22, 49.17s/it]
                                                     
{'loss': 0.0024, 'grad_norm': 1.3190845251083374, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571566939354, 'rewards/format_reward': 1.0, 'reward': 1.2678571939468384, 'reward_std': 0.1071428619325161, 'completion_length': 101.37500762939453, 'kl': 0.059326171875, 'epoch': 0.36}

 72%|███████▏  | 206/287 [2:17:38<1:06:22, 49.17s/it]WARNING 05-11 21:59:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 21:59:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 72%|███████▏  | 207/287 [2:18:50<1:14:38, 55.98s/it]
                                                     
{'loss': 0.0022, 'grad_norm': 0.5949472784996033, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571492433548, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2500000596046448, 'reward_std': 0.0714285746216774, 'completion_length': 103.33929061889648, 'kl': 0.054443359375, 'epoch': 0.36}

 72%|███████▏  | 207/287 [2:18:50<1:14:38, 55.98s/it]WARNING 05-11 22:00:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 72%|███████▏  | 208/287 [2:19:13<1:00:54, 46.26s/it]
                                                     
{'loss': 0.0011, 'grad_norm': 0.4953426718711853, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.517857164144516, 'rewards/format_reward': 1.0, 'reward': 1.5178571939468384, 'reward_std': 0.0357142873108387, 'completion_length': 64.53571701049805, 'kl': 0.027435302734375, 'epoch': 0.36}

 72%|███████▏  | 208/287 [2:19:13<1:00:54, 46.26s/it]WARNING 05-11 22:00:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:00:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:01:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:01:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:01:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:01:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:01:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:01:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:01:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 73%|███████▎  | 209/287 [2:20:19<1:07:54, 52.23s/it]
                                                     
{'loss': 0.0026, 'grad_norm': 3.7949793338775635, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714626312256, 'rewards/format_reward': 0.9642857313156128, 'reward': 1.3928571939468384, 'reward_std': 0.3440354913473129, 'completion_length': 120.4285774230957, 'kl': 0.066162109375, 'epoch': 0.36}

 73%|███████▎  | 209/287 [2:20:19<1:07:54, 52.23s/it]WARNING 05-11 22:02:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 73%|███████▎  | 210/287 [2:21:14<1:07:58, 52.97s/it]
                                                     
{'loss': 0.0017, 'grad_norm': 0.4912646412849426, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857143059372902, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.0357142873108387, 'completion_length': 113.41071891784668, 'kl': 0.041748046875, 'epoch': 0.37}

 73%|███████▎  | 210/287 [2:21:14<1:07:58, 52.97s/it]WARNING 05-11 22:02:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:02:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 74%|███████▎  | 211/287 [2:22:02<1:05:13, 51.50s/it]
                                                     
{'loss': 0.0091, 'grad_norm': 4.9927544593811035, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857313156128, 'reward_std': 0.14838216826319695, 'completion_length': 66.25000190734863, 'kl': 0.22735595703125, 'epoch': 0.37}

 74%|███████▎  | 211/287 [2:22:02<1:05:13, 51.50s/it]WARNING 05-11 22:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:03:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 74%|███████▍  | 212/287 [2:22:29<55:05, 44.07s/it]  
                                                   
{'loss': 0.0022, 'grad_norm': 1.5024620294570923, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3928571939468384, 'reward_std': 0.0714285746216774, 'completion_length': 59.607147216796875, 'kl': 0.0560302734375, 'epoch': 0.37}

 74%|███████▍  | 212/287 [2:22:29<55:05, 44.07s/it]WARNING 05-11 22:04:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 74%|███████▍  | 213/287 [2:22:53<46:57, 38.08s/it]
                                                   
{'loss': 0.003, 'grad_norm': 3.161621570587158, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.1428571529686451, 'completion_length': 69.50000381469727, 'kl': 0.0760498046875, 'epoch': 0.37}

 74%|███████▍  | 213/287 [2:22:53<46:57, 38.08s/it]WARNING 05-11 22:04:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 75%|███████▍  | 214/287 [2:23:07<37:28, 30.81s/it]
                                                   
{'loss': 0.0024, 'grad_norm': 3.6922237873077393, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.1071428656578064, 'completion_length': 25.35714340209961, 'kl': 0.0594482421875, 'epoch': 0.37}

 75%|███████▍  | 214/287 [2:23:07<37:28, 30.81s/it]WARNING 05-11 22:04:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:04:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:00 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 75%|███████▍  | 215/287 [2:23:35<36:07, 30.10s/it]
                                                   
{'loss': 0.002, 'grad_norm': 0.13601039350032806, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5714285969734192, 'rewards/format_reward': 1.0, 'reward': 1.571428656578064, 'reward_std': 0.0, 'completion_length': 45.67857360839844, 'kl': 0.0501708984375, 'epoch': 0.37}

 75%|███████▍  | 215/287 [2:23:35<36:07, 30.10s/it]WARNING 05-11 22:05:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 75%|███████▌  | 216/287 [2:24:06<35:59, 30.41s/it]
                                                   
{'loss': 0.0015, 'grad_norm': 2.2772905826568604, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714626312256, 'rewards/format_reward': 1.0, 'reward': 1.4285714626312256, 'reward_std': 0.0824786126613617, 'completion_length': 52.37500190734863, 'kl': 0.0379638671875, 'epoch': 0.38}

 75%|███████▌  | 216/287 [2:24:06<35:59, 30.41s/it]WARNING 05-11 22:05:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:05:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 76%|███████▌  | 217/287 [2:24:35<34:45, 29.79s/it]
                                                   
{'loss': 0.0042, 'grad_norm': 2.4224965572357178, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.0714285746216774, 'completion_length': 75.3214340209961, 'kl': 0.1064453125, 'epoch': 0.38}

 76%|███████▌  | 217/287 [2:24:35<34:45, 29.79s/it]WARNING 05-11 22:06:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 76%|███████▌  | 218/287 [2:25:03<33:35, 29.21s/it]
                                                   
{'loss': 0.0056, 'grad_norm': 24.684690475463867, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107143133878708, 'rewards/format_reward': 1.0, 'reward': 1.410714328289032, 'reward_std': 0.14838216826319695, 'completion_length': 75.91071701049805, 'kl': 0.14093017578125, 'epoch': 0.38}

 76%|███████▌  | 218/287 [2:25:03<33:35, 29.21s/it]WARNING 05-11 22:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:06:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 76%|███████▋  | 219/287 [2:25:39<35:33, 31.38s/it]
                                                   
{'loss': 0.0015, 'grad_norm': 0.6959549784660339, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.0357142873108387, 'completion_length': 56.41071701049805, 'kl': 0.03759765625, 'epoch': 0.38}

 76%|███████▋  | 219/287 [2:25:39<35:33, 31.38s/it]WARNING 05-11 22:07:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 77%|███████▋  | 220/287 [2:26:13<35:54, 32.16s/it]
                                                   
{'loss': 0.0031, 'grad_norm': 3.4052894115448, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.535714328289032, 'rewards/format_reward': 1.0, 'reward': 1.535714328289032, 'reward_std': 0.11266788095235825, 'completion_length': 64.92857265472412, 'kl': 0.078369140625, 'epoch': 0.38}

 77%|███████▋  | 220/287 [2:26:13<35:54, 32.16s/it]WARNING 05-11 22:07:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:07:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 77%|███████▋  | 221/287 [2:26:25<28:39, 26.06s/it]
                                                   
{'loss': 0.0024, 'grad_norm': 3.875488758087158, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857313156128, 'reward_std': 0.1071428619325161, 'completion_length': 20.46428632736206, 'kl': 0.0592041015625, 'epoch': 0.39}

 77%|███████▋  | 221/287 [2:26:25<28:39, 26.06s/it]WARNING 05-11 22:08:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:21 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 77%|███████▋  | 222/287 [2:26:47<27:05, 25.01s/it]
                                                   
{'loss': 0.0016, 'grad_norm': 2.3049814701080322, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2500000149011612, 'rewards/format_reward': 1.0, 'reward': 1.2500000596046448, 'reward_std': 0.0714285746216774, 'completion_length': 41.58928680419922, 'kl': 0.0411376953125, 'epoch': 0.39}

 77%|███████▋  | 222/287 [2:26:47<27:05, 25.01s/it]WARNING 05-11 22:08:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:32 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 78%|███████▊  | 223/287 [2:27:08<25:18, 23.73s/it]
                                                   
{'loss': 0.0027, 'grad_norm': 2.913188934326172, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.23086076974868774, 'completion_length': 58.196431159973145, 'kl': 0.068603515625, 'epoch': 0.39}

 78%|███████▊  | 223/287 [2:27:08<25:18, 23.73s/it]WARNING 05-11 22:08:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:08:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 78%|███████▊  | 224/287 [2:27:26<22:59, 21.90s/it]
                                                   
{'loss': 0.0048, 'grad_norm': 3.3108372688293457, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.6071428656578064, 'rewards/format_reward': 1.0, 'reward': 1.607142984867096, 'reward_std': 0.11266788095235825, 'completion_length': 42.91071605682373, 'kl': 0.119384765625, 'epoch': 0.39}

 78%|███████▊  | 224/287 [2:27:26<22:59, 21.90s/it]WARNING 05-11 22:09:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 78%|███████▊  | 225/287 [2:27:34<18:23, 17.81s/it]
                                                   
{'loss': 0.0045, 'grad_norm': 3.0562548637390137, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.10714286006987095, 'rewards/format_reward': 1.0, 'reward': 1.1071429252624512, 'reward_std': 0.11266787722706795, 'completion_length': 19.642857551574707, 'kl': 0.1123046875, 'epoch': 0.39}

 78%|███████▊  | 225/287 [2:27:34<18:23, 17.81s/it]WARNING 05-11 22:09:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 79%|███████▊  | 226/287 [2:27:58<19:55, 19.61s/it]
                                                   
{'loss': 0.0029, 'grad_norm': 4.9722065925598145, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.446428582072258, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.2610500305891037, 'completion_length': 38.92857360839844, 'kl': 0.072265625, 'epoch': 0.39}

 79%|███████▊  | 226/287 [2:27:58<19:55, 19.61s/it]WARNING 05-11 22:09:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 79%|███████▉  | 227/287 [2:28:12<17:56, 17.94s/it]
                                                   
{'loss': 0.0027, 'grad_norm': 3.0860748291015625, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.321428582072258, 'rewards/format_reward': 1.0, 'reward': 1.3214285969734192, 'reward_std': 0.1539071835577488, 'completion_length': 23.83928680419922, 'kl': 0.06781005859375, 'epoch': 0.4}

 79%|███████▉  | 227/287 [2:28:12<17:56, 17.94s/it]WARNING 05-11 22:09:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:09:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:05 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 79%|███████▉  | 228/287 [2:28:23<15:39, 15.92s/it]
                                                   
{'loss': 0.0023, 'grad_norm': 3.8439905643463135, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428656578064, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.18409645557403564, 'completion_length': 19.83928632736206, 'kl': 0.05712890625, 'epoch': 0.4}

 79%|███████▉  | 228/287 [2:28:23<15:39, 15.92s/it]WARNING 05-11 22:10:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:10:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 80%|███████▉  | 229/287 [2:29:27<29:10, 30.18s/it]
                                                   
{'loss': 0.0028, 'grad_norm': 2.001723051071167, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.6071428954601288, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.5892857909202576, 'reward_std': 0.1071428619325161, 'completion_length': 78.39286041259766, 'kl': 0.0699462890625, 'epoch': 0.4}

 80%|███████▉  | 229/287 [2:29:27<29:10, 30.18s/it]WARNING 05-11 22:11:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 80%|████████  | 230/287 [2:29:41<24:16, 25.55s/it]
                                                   
{'loss': 0.0021, 'grad_norm': 2.262601375579834, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 1.0, 'reward': 1.2857143878936768, 'reward_std': 0.11266788095235825, 'completion_length': 26.48214340209961, 'kl': 0.0516357421875, 'epoch': 0.4}

 80%|████████  | 230/287 [2:29:41<24:16, 25.55s/it]WARNING 05-11 22:11:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:25 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 80%|████████  | 231/287 [2:29:53<19:54, 21.32s/it]
                                                   
{'loss': 0.0031, 'grad_norm': 2.6830737590789795, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.535714328289032, 'rewards/format_reward': 1.0, 'reward': 1.535714328289032, 'reward_std': 0.1428571492433548, 'completion_length': 23.857144355773926, 'kl': 0.076904296875, 'epoch': 0.4}

 80%|████████  | 231/287 [2:29:53<19:54, 21.32s/it]WARNING 05-11 22:11:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:11:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 81%|████████  | 232/287 [2:30:30<23:48, 25.97s/it]
                                                   
{'loss': 0.0017, 'grad_norm': 2.1234936714172363, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000298023224, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.07695358991622925, 'completion_length': 81.03571701049805, 'kl': 0.04241943359375, 'epoch': 0.4}

 81%|████████  | 232/287 [2:30:30<23:48, 25.97s/it]WARNING 05-11 22:12:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:14 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:20 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 81%|████████  | 233/287 [2:30:47<21:06, 23.45s/it]
                                                   
{'loss': 0.0013, 'grad_norm': 2.8734660148620605, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.1428571529686451, 'completion_length': 38.58928680419922, 'kl': 0.031494140625, 'epoch': 0.41}

 81%|████████  | 233/287 [2:30:47<21:06, 23.45s/it]WARNING 05-11 22:12:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 82%|████████▏ | 234/287 [2:31:02<18:22, 20.80s/it]
                                                   
{'loss': 0.0055, 'grad_norm': 3.151475429534912, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.11266788095235825, 'completion_length': 33.64285850524902, 'kl': 0.1373291015625, 'epoch': 0.41}

 82%|████████▏ | 234/287 [2:31:02<18:22, 20.80s/it]WARNING 05-11 22:12:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 82%|████████▏ | 235/287 [2:31:14<15:54, 18.35s/it]
                                                   
{'loss': 0.0014, 'grad_norm': 2.901553153991699, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.517857164144516, 'rewards/format_reward': 1.0, 'reward': 1.5178571939468384, 'reward_std': 0.1071428619325161, 'completion_length': 32.03571605682373, 'kl': 0.035888671875, 'epoch': 0.41}

 82%|████████▏ | 235/287 [2:31:14<15:54, 18.35s/it]WARNING 05-11 22:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:12:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 82%|████████▏ | 236/287 [2:31:40<17:30, 20.60s/it]
                                                   
{'loss': 0.0021, 'grad_norm': 2.558964252471924, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.1071428619325161, 'completion_length': 53.91071796417236, 'kl': 0.051513671875, 'epoch': 0.41}

 82%|████████▏ | 236/287 [2:31:40<17:30, 20.60s/it]WARNING 05-11 22:13:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 83%|████████▎ | 237/287 [2:32:11<19:40, 23.62s/it]
                                                   
{'loss': 0.0027, 'grad_norm': 3.1964447498321533, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571566939354, 'rewards/format_reward': 1.0, 'reward': 1.2678571939468384, 'reward_std': 0.14838215708732605, 'completion_length': 73.64285850524902, 'kl': 0.0670166015625, 'epoch': 0.41}

 83%|████████▎ | 237/287 [2:32:11<19:40, 23.62s/it]WARNING 05-11 22:13:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:13:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 83%|████████▎ | 238/287 [2:33:07<27:18, 33.44s/it]
                                                   
{'loss': 0.0014, 'grad_norm': 3.3176755905151367, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.267857164144516, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2500000596046448, 'reward_std': 0.26657505333423615, 'completion_length': 73.64286041259766, 'kl': 0.0361328125, 'epoch': 0.41}

 83%|████████▎ | 238/287 [2:33:07<27:18, 33.44s/it]WARNING 05-11 22:14:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:14:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 83%|████████▎ | 239/287 [2:33:24<22:47, 28.49s/it]
                                                   
{'loss': 0.0014, 'grad_norm': 2.2765233516693115, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107142984867096, 'rewards/format_reward': 1.0, 'reward': 1.4107143878936768, 'reward_std': 0.21981073170900345, 'completion_length': 38.55357360839844, 'kl': 0.03387451171875, 'epoch': 0.42}

 83%|████████▎ | 239/287 [2:33:24<22:47, 28.49s/it]WARNING 05-11 22:15:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:08 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:24 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 84%|████████▎ | 240/287 [2:33:42<19:50, 25.32s/it]
                                                   
{'loss': 0.0016, 'grad_norm': 3.0223140716552734, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2142857313156128, 'rewards/format_reward': 1.0, 'reward': 1.2142857313156128, 'reward_std': 0.11266788095235825, 'completion_length': 48.553574085235596, 'kl': 0.040771484375, 'epoch': 0.42}

 84%|████████▎ | 240/287 [2:33:42<19:50, 25.32s/it]WARNING 05-11 22:15:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:36 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 84%|████████▍ | 241/287 [2:34:03<18:26, 24.05s/it]
                                                   
{'loss': 0.0016, 'grad_norm': 1.7885396480560303, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.446428582072258, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.0357142873108387, 'completion_length': 35.42857360839844, 'kl': 0.0411376953125, 'epoch': 0.42}

 84%|████████▍ | 241/287 [2:34:03<18:26, 24.05s/it]WARNING 05-11 22:15:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:15:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 84%|████████▍ | 242/287 [2:34:23<17:02, 22.72s/it]
                                                   
{'loss': 0.0031, 'grad_norm': 1.513298511505127, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714477300644, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.0714285746216774, 'completion_length': 39.91071605682373, 'kl': 0.0782470703125, 'epoch': 0.42}

 84%|████████▍ | 242/287 [2:34:23<17:02, 22.72s/it]WARNING 05-11 22:16:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:07 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:13 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 85%|████████▍ | 243/287 [2:34:42<15:53, 21.66s/it]
                                                   
{'loss': 0.0016, 'grad_norm': 3.2757785320281982, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.392857164144516, 'rewards/format_reward': 1.0, 'reward': 1.3928571939468384, 'reward_std': 0.0714285746216774, 'completion_length': 39.482144355773926, 'kl': 0.038818359375, 'epoch': 0.42}

 85%|████████▍ | 243/287 [2:34:42<15:53, 21.66s/it]WARNING 05-11 22:16:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 85%|████████▌ | 244/287 [2:35:01<15:00, 20.95s/it]
                                                   
{'loss': 0.0021, 'grad_norm': 3.129863739013672, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4642857313156128, 'rewards/format_reward': 1.0, 'reward': 1.4642857909202576, 'reward_std': 0.11266788095235825, 'completion_length': 41.14285850524902, 'kl': 0.051513671875, 'epoch': 0.43}

 85%|████████▌ | 244/287 [2:35:01<15:00, 20.95s/it]WARNING 05-11 22:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:16:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 85%|████████▌ | 245/287 [2:35:31<16:25, 23.46s/it]
                                                   
{'loss': 0.0018, 'grad_norm': 1.4222726821899414, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000149011612, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.07695358991622925, 'completion_length': 60.00000190734863, 'kl': 0.044677734375, 'epoch': 0.43}

 85%|████████▌ | 245/287 [2:35:31<16:25, 23.46s/it]WARNING 05-11 22:17:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:15 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:31 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 86%|████████▌ | 246/287 [2:36:00<17:08, 25.10s/it]
                                                   
{'loss': 0.0014, 'grad_norm': 2.3192427158355713, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2321428656578064, 'rewards/format_reward': 1.0, 'reward': 1.2321428656578064, 'reward_std': 0.1181928962469101, 'completion_length': 89.55357360839844, 'kl': 0.03546142578125, 'epoch': 0.43}

 86%|████████▌ | 246/287 [2:36:00<17:08, 25.10s/it]WARNING 05-11 22:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:44 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 86%|████████▌ | 247/287 [2:36:15<14:51, 22.28s/it]
                                                   
{'loss': 0.0021, 'grad_norm': 1.7217658758163452, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857313156128, 'rewards/format_reward': 1.0, 'reward': 1.3392857313156128, 'reward_std': 0.07695359364151955, 'completion_length': 44.67857360839844, 'kl': 0.0533447265625, 'epoch': 0.43}

 86%|████████▌ | 247/287 [2:36:15<14:51, 22.28s/it]WARNING 05-11 22:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:17:59 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:16 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 86%|████████▋ | 248/287 [2:36:43<15:30, 23.86s/it]
                                                   
{'loss': 0.0024, 'grad_norm': 2.2065553665161133, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428805589676, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.0357142873108387, 'completion_length': 50.03571701049805, 'kl': 0.05963134765625, 'epoch': 0.43}

 86%|████████▋ | 248/287 [2:36:43<15:30, 23.86s/it]WARNING 05-11 22:18:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 87%|████████▋ | 249/287 [2:37:01<14:07, 22.31s/it]
                                                   
{'loss': 0.003, 'grad_norm': 2.262007474899292, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857143059372902, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2678571939468384, 'reward_std': 0.14838215708732605, 'completion_length': 52.83928680419922, 'kl': 0.0758056640625, 'epoch': 0.43}

 87%|████████▋ | 249/287 [2:37:01<14:07, 22.31s/it]WARNING 05-11 22:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:18:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 87%|████████▋ | 250/287 [2:37:25<13:55, 22.58s/it]
                                                   
{'loss': 0.0013, 'grad_norm': 1.8002805709838867, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428656578064, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.07695359364151955, 'completion_length': 55.14285850524902, 'kl': 0.03204345703125, 'epoch': 0.44}

 87%|████████▋ | 250/287 [2:37:25<13:55, 22.58s/it]WARNING 05-11 22:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 87%|████████▋ | 251/287 [2:37:52<14:29, 24.15s/it]
                                                   
{'loss': 0.0011, 'grad_norm': 2.9369969367980957, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3392857387661934, 'rewards/format_reward': 1.0, 'reward': 1.3392857909202576, 'reward_std': 0.1071428619325161, 'completion_length': 79.8214340209961, 'kl': 0.027587890625, 'epoch': 0.44}

 87%|████████▋ | 251/287 [2:37:53<14:29, 24.15s/it]WARNING 05-11 22:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:49 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 88%|████████▊ | 252/287 [2:38:09<12:48, 21.96s/it]
                                                   
{'loss': 0.001, 'grad_norm': 2.731036424636841, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000149011612, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.0714285746216774, 'completion_length': 45.82143020629883, 'kl': 0.02606201171875, 'epoch': 0.44}

 88%|████████▊ | 252/287 [2:38:09<12:48, 21.96s/it]WARNING 05-11 22:19:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:19:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 88%|████████▊ | 253/287 [2:38:32<12:38, 22.31s/it]
                                                   
{'loss': 0.0018, 'grad_norm': 2.5574827194213867, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5714286118745804, 'rewards/format_reward': 1.0, 'reward': 1.571428656578064, 'reward_std': 0.19514649361371994, 'completion_length': 63.410715103149414, 'kl': 0.0458984375, 'epoch': 0.44}

 88%|████████▊ | 253/287 [2:38:32<12:38, 22.31s/it]WARNING 05-11 22:20:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 89%|████████▊ | 254/287 [2:38:58<12:51, 23.37s/it]
                                                   
{'loss': 0.002, 'grad_norm': 1.6678736209869385, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000298023224, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.0714285746216774, 'completion_length': 79.80357360839844, 'kl': 0.049072265625, 'epoch': 0.44}

 89%|████████▊ | 254/287 [2:38:58<12:51, 23.37s/it]WARNING 05-11 22:20:42 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:20:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 89%|████████▉ | 255/287 [2:39:27<13:17, 24.91s/it]
                                                   
{'loss': 0.002, 'grad_norm': 7.65718412399292, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5535714477300644, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.535714328289032, 'reward_std': 0.2142857313156128, 'completion_length': 70.32143020629883, 'kl': 0.0489501953125, 'epoch': 0.44}

 89%|████████▉ | 255/287 [2:39:27<13:17, 24.91s/it]WARNING 05-11 22:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:11 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 89%|████████▉ | 256/287 [2:39:51<12:41, 24.56s/it]
                                                   
{'loss': 0.001, 'grad_norm': 0.7356625199317932, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 1.0, 'reward': 1.4464285969734192, 'reward_std': 0.0357142873108387, 'completion_length': 78.19643020629883, 'kl': 0.02374267578125, 'epoch': 0.45}

 89%|████████▉ | 256/287 [2:39:51<12:41, 24.56s/it]WARNING 05-11 22:21:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:21:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 90%|████████▉ | 257/287 [2:40:50<17:30, 35.00s/it]
                                                   
{'loss': 0.0011, 'grad_norm': 1.3749505281448364, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714514553547, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2857143878936768, 'reward_std': 0.11266788095235825, 'completion_length': 97.03572082519531, 'kl': 0.02716064453125, 'epoch': 0.45}

 90%|████████▉ | 257/287 [2:40:50<17:30, 35.00s/it]WARNING 05-11 22:22:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:22:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 90%|████████▉ | 258/287 [2:41:19<16:04, 33.27s/it]
                                                   
{'loss': 0.0013, 'grad_norm': 2.2879624366760254, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000298023224, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.11266788095235825, 'completion_length': 89.10714721679688, 'kl': 0.033203125, 'epoch': 0.45}

 90%|████████▉ | 258/287 [2:41:19<16:04, 33.27s/it]WARNING 05-11 22:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 90%|█████████ | 259/287 [2:41:50<15:09, 32.48s/it]
                                                   
{'loss': 0.0009, 'grad_norm': 1.6667253971099854, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2321428693830967, 'rewards/format_reward': 1.0, 'reward': 1.2321429252624512, 'reward_std': 0.1181928962469101, 'completion_length': 107.75000381469727, 'kl': 0.0224609375, 'epoch': 0.45}

 90%|█████████ | 259/287 [2:41:50<15:09, 32.48s/it]WARNING 05-11 22:23:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:34 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:23:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 91%|█████████ | 260/287 [2:42:25<14:54, 33.15s/it]
                                                   
{'loss': 0.0015, 'grad_norm': 1.629365086555481, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.446428582072258, 'rewards/format_reward': 1.0, 'reward': 1.446428656578064, 'reward_std': 0.1181928999722004, 'completion_length': 100.92857360839844, 'kl': 0.03753662109375, 'epoch': 0.45}

 91%|█████████ | 260/287 [2:42:25<14:54, 33.15s/it]WARNING 05-11 22:24:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:30 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 91%|█████████ | 261/287 [2:42:57<14:18, 33.00s/it]
                                                   
{'loss': 0.0016, 'grad_norm': 2.7837705612182617, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1428571492433548, 'rewards/format_reward': 1.0, 'reward': 1.1428571939468384, 'reward_std': 0.0714285746216774, 'completion_length': 77.91071701049805, 'kl': 0.0404052734375, 'epoch': 0.45}

 91%|█████████ | 261/287 [2:42:57<14:18, 33.00s/it]WARNING 05-11 22:24:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:41 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:24:52 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 91%|█████████▏| 262/287 [2:43:20<12:25, 29.84s/it]
                                                   
{'loss': 0.0014, 'grad_norm': 1.6045894622802734, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2857142984867096, 'rewards/format_reward': 1.0, 'reward': 1.285714328289032, 'reward_std': 0.1428571492433548, 'completion_length': 90.67857360839844, 'kl': 0.034423828125, 'epoch': 0.46}

 91%|█████████▏| 262/287 [2:43:20<12:25, 29.84s/it]WARNING 05-11 22:25:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:18 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 92%|█████████▏| 263/287 [2:43:45<11:24, 28.53s/it]
                                                   
{'loss': 0.0006, 'grad_norm': 1.7677127122879028, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.642857164144516, 'rewards/format_reward': 1.0, 'reward': 1.6428571939468384, 'reward_std': 0.18409644439816475, 'completion_length': 110.35714721679688, 'kl': 0.015869140625, 'epoch': 0.46}

 92%|█████████▏| 263/287 [2:43:45<11:24, 28.53s/it]WARNING 05-11 22:25:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:25:56 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 92%|█████████▏| 264/287 [2:44:26<12:20, 32.20s/it]
                                                   
{'loss': 0.0017, 'grad_norm': 3.4501304626464844, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2321428693830967, 'rewards/format_reward': 1.0, 'reward': 1.2321429252624512, 'reward_std': 0.1181928962469101, 'completion_length': 166.0535774230957, 'kl': 0.041229248046875, 'epoch': 0.46}

 92%|█████████▏| 264/287 [2:44:26<12:20, 32.20s/it]WARNING 05-11 22:26:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:10 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:26:58 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 92%|█████████▏| 265/287 [2:45:25<14:44, 40.19s/it]
                                                   
{'loss': 0.0011, 'grad_norm': 1.3744620084762573, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5535714328289032, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.535714328289032, 'reward_std': 0.18409645557403564, 'completion_length': 115.92857933044434, 'kl': 0.02655029296875, 'epoch': 0.46}

 92%|█████████▏| 265/287 [2:45:25<14:44, 40.19s/it]WARNING 05-11 22:27:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:23 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 93%|█████████▎| 266/287 [2:45:55<12:58, 37.07s/it]
                                                   
{'loss': 0.0012, 'grad_norm': 4.392531871795654, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.196428582072258, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.14838216826319695, 'completion_length': 115.62500381469727, 'kl': 0.031158447265625, 'epoch': 0.46}

 93%|█████████▎| 266/287 [2:45:55<12:58, 37.07s/it]WARNING 05-11 22:27:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:27:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 93%|█████████▎| 267/287 [2:46:22<11:24, 34.20s/it]
                                                   
{'loss': 0.0019, 'grad_norm': 3.640169143676758, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.1964285746216774, 'rewards/format_reward': 1.0, 'reward': 1.1964285969734192, 'reward_std': 0.1071428619325161, 'completion_length': 121.91071701049805, 'kl': 0.0474853515625, 'epoch': 0.47}

 93%|█████████▎| 267/287 [2:46:22<11:24, 34.20s/it]WARNING 05-11 22:28:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:28:54 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 93%|█████████▎| 268/287 [2:47:28<13:51, 43.79s/it]
                                                   
{'loss': 0.0013, 'grad_norm': 1.8763225078582764, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.6071428954601288, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.5892857909202576, 'reward_std': 0.17651408910751343, 'completion_length': 154.96429443359375, 'kl': 0.03179931640625, 'epoch': 0.47}

 93%|█████████▎| 268/287 [2:47:28<13:51, 43.79s/it]WARNING 05-11 22:29:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:12 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 94%|█████████▎| 269/287 [2:47:59<11:58, 39.94s/it]
                                                   
{'loss': 0.0024, 'grad_norm': 8.722392082214355, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 1.0, 'reward': 1.3571429252624512, 'reward_std': 0.2253357544541359, 'completion_length': 131.8214340209961, 'kl': 0.0595703125, 'epoch': 0.47}

 94%|█████████▎| 269/287 [2:47:59<11:58, 39.94s/it]WARNING 05-11 22:29:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:29:43 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:02 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 94%|█████████▍| 270/287 [2:49:07<13:40, 48.24s/it]
                                                   
{'loss': 0.0016, 'grad_norm': 2.6933844089508057, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428805589676, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3392857909202576, 'reward_std': 0.25248410552740097, 'completion_length': 231.5178680419922, 'kl': 0.03900146484375, 'epoch': 0.47}

 94%|█████████▍| 270/287 [2:49:07<13:40, 48.24s/it]WARNING 05-11 22:30:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:30:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:38 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 94%|█████████▍| 271/287 [2:50:03<13:30, 50.67s/it]
                                                   
{'loss': 0.0011, 'grad_norm': 3.307760715484619, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3571428656578064, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3392857313156128, 'reward_std': 0.2610500380396843, 'completion_length': 109.9464340209961, 'kl': 0.0274658203125, 'epoch': 0.47}

 94%|█████████▍| 271/287 [2:50:03<13:30, 50.67s/it]WARNING 05-11 22:31:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:31:47 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 95%|█████████▍| 272/287 [2:51:07<13:38, 54.60s/it]
                                                   
{'loss': 0.0011, 'grad_norm': 1.1044070720672607, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4107143133878708, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.3928571939468384, 'reward_std': 0.0714285746216774, 'completion_length': 159.1964340209961, 'kl': 0.02850341796875, 'epoch': 0.47}

 95%|█████████▍| 272/287 [2:51:07<13:38, 54.60s/it]WARNING 05-11 22:32:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:32:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:04 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 95%|█████████▌| 273/287 [2:52:09<13:16, 56.91s/it]
                                                   
{'loss': 0.0011, 'grad_norm': 2.243589162826538, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714477300644, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.285714328289032, 'reward_std': 0.12974976375699043, 'completion_length': 128.1607208251953, 'kl': 0.02850341796875, 'epoch': 0.48}

 95%|█████████▌| 273/287 [2:52:09<13:16, 56.91s/it]WARNING 05-11 22:33:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:33:53 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:06 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 95%|█████████▌| 274/287 [2:52:44<10:52, 50.17s/it]
                                                   
{'loss': 0.0012, 'grad_norm': 2.8491549491882324, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.535714328289032, 'rewards/format_reward': 1.0, 'reward': 1.535714328289032, 'reward_std': 0.18409645557403564, 'completion_length': 165.16072463989258, 'kl': 0.02972412109375, 'epoch': 0.48}

 95%|█████████▌| 274/287 [2:52:44<10:52, 50.17s/it]WARNING 05-11 22:34:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:28 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:37 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 96%|█████████▌| 275/287 [2:53:07<08:25, 42.08s/it]
                                                   
{'loss': 0.0009, 'grad_norm': 3.0334911346435547, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000298023224, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.1428571529686451, 'completion_length': 147.46429061889648, 'kl': 0.0225830078125, 'epoch': 0.48}

 96%|█████████▌| 275/287 [2:53:07<08:25, 42.08s/it]WARNING 05-11 22:34:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:34:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 96%|█████████▌| 276/287 [2:54:06<08:38, 47.12s/it]
                                                   
{'loss': 0.0024, 'grad_norm': 2.608999729156494, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714626312256, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.410714328289032, 'reward_std': 0.1071428619325161, 'completion_length': 128.83929443359375, 'kl': 0.0595703125, 'epoch': 0.48}

 96%|█████████▌| 276/287 [2:54:06<08:38, 47.12s/it]WARNING 05-11 22:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:35:50 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:03 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 97%|█████████▋| 277/287 [2:54:33<06:51, 41.13s/it]
                                                   
{'loss': 0.0013, 'grad_norm': 1.8549308776855469, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4285714328289032, 'rewards/format_reward': 1.0, 'reward': 1.4285715222358704, 'reward_std': 0.11266788095235825, 'completion_length': 116.28572463989258, 'kl': 0.0318603515625, 'epoch': 0.48}

 97%|█████████▋| 277/287 [2:54:33<06:51, 41.13s/it]WARNING 05-11 22:36:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:26 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 97%|█████████▋| 278/287 [2:54:56<05:21, 35.74s/it]
                                                   
{'loss': 0.001, 'grad_norm': 2.1096863746643066, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428954601288, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4642857909202576, 'reward_std': 0.11266787722706795, 'completion_length': 87.85714340209961, 'kl': 0.025634765625, 'epoch': 0.48}

 97%|█████████▋| 278/287 [2:54:56<05:21, 35.74s/it]WARNING 05-11 22:36:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:36:57 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 97%|█████████▋| 279/287 [2:56:02<05:58, 44.79s/it]
                                                   
{'loss': 0.0023, 'grad_norm': 2.6998660564422607, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000149011612, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.4821429252624512, 'reward_std': 0.14838216453790665, 'completion_length': 214.91072845458984, 'kl': 0.05810546875, 'epoch': 0.49}

 97%|█████████▋| 279/287 [2:56:02<05:58, 44.79s/it]WARNING 05-11 22:37:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:37:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:37:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:37:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:37:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:37:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:37:46 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:01 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 98%|█████████▊| 280/287 [2:56:33<04:43, 40.56s/it]
                                                   
{'loss': 0.0005, 'grad_norm': 2.9272570610046387, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3750000298023224, 'rewards/format_reward': 1.0, 'reward': 1.3750000596046448, 'reward_std': 0.1071428619325161, 'completion_length': 164.96429443359375, 'kl': 0.0130615234375, 'epoch': 0.49}

 98%|█████████▊| 280/287 [2:56:33<04:43, 40.56s/it]WARNING 05-11 22:38:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:17 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:35 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 98%|█████████▊| 281/287 [2:57:07<03:51, 38.62s/it]
                                                   
{'loss': 0.0009, 'grad_norm': 0.9428696632385254, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428805589676, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.07695358991622925, 'completion_length': 180.2857208251953, 'kl': 0.0228271484375, 'epoch': 0.49}

 98%|█████████▊| 281/287 [2:57:07<03:51, 38.62s/it]WARNING 05-11 22:38:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:38:51 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:19 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 98%|█████████▊| 282/287 [2:57:56<03:29, 41.83s/it]
                                                   
{'loss': 0.018, 'grad_norm': 9.989897727966309, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.267857164144516, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2500000596046448, 'reward_std': 0.25552503019571304, 'completion_length': 131.64286041259766, 'kl': 0.4486083984375, 'epoch': 0.49}

 98%|█████████▊| 282/287 [2:57:56<03:29, 41.83s/it]WARNING 05-11 22:39:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:40 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:39:55 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 99%|█████████▊| 283/287 [2:59:00<03:14, 48.61s/it]
                                                   
{'loss': 0.001, 'grad_norm': 0.8110054135322571, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.3035714514553547, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2857143878936768, 'reward_std': 0.1428571529686451, 'completion_length': 164.87500381469727, 'kl': 0.026123046875, 'epoch': 0.49}

 99%|█████████▊| 283/287 [2:59:00<03:14, 48.61s/it]WARNING 05-11 22:40:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:40:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:40:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:40:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:40:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:40:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:40:45 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:29 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 99%|█████████▉| 284/287 [3:00:04<02:39, 53.07s/it]
                                                   
{'loss': 0.0483, 'grad_norm': 27.112613677978516, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4464285969734192, 'rewards/format_reward': 1.0, 'reward': 1.4464285969734192, 'reward_std': 0.1896214708685875, 'completion_length': 196.9107208251953, 'kl': 1.20269775390625, 'epoch': 0.49}

 99%|█████████▉| 284/287 [3:00:04<02:39, 53.07s/it]WARNING 05-11 22:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:41:48 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:09 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

 99%|█████████▉| 285/287 [3:00:43<01:37, 48.82s/it]
                                                   
{'loss': 0.0018, 'grad_norm': 1.9164234399795532, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.5000000298023224, 'rewards/format_reward': 1.0, 'reward': 1.5000000596046448, 'reward_std': 0.1539071835577488, 'completion_length': 134.58929061889648, 'kl': 0.04534912109375, 'epoch': 0.5}

 99%|█████████▉| 285/287 [3:00:43<01:37, 48.82s/it]WARNING 05-11 22:42:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:27 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:42:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

100%|█████████▉| 286/287 [3:01:38<00:50, 50.74s/it]
                                                   
{'loss': 0.0006, 'grad_norm': 0.3995811939239502, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.4821428805589676, 'rewards/format_reward': 1.0, 'reward': 1.4821429252624512, 'reward_std': 0.0357142873108387, 'completion_length': 174.03572463989258, 'kl': 0.0155029296875, 'epoch': 0.5}

100%|█████████▉| 286/287 [3:01:38<00:50, 50.74s/it]WARNING 05-11 22:43:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:22 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}
WARNING 05-11 22:43:39 utils.py:1445] The following intended overrides are not keyword-only args and and will be dropped: {'max_pixels', 'min_pixels'}

100%|██████████| 287/287 [3:02:44<00:00, 55.39s/it]
                                                   
{'loss': 0.0014, 'grad_norm': 1.431549310684204, 'learning_rate': 1e-06, 'rewards/accuracy_reward': 0.2678571566939354, 'rewards/format_reward': 0.9821428656578064, 'reward': 1.2500000596046448, 'reward_std': 0.1428571529686451, 'completion_length': 189.6964340209961, 'kl': 0.0361328125, 'epoch': 0.5}

100%|██████████| 287/287 [3:02:44<00:00, 55.39s/it]
                                                   
{'train_runtime': 11009.2925, 'train_samples_per_second': 0.365, 'train_steps_per_second': 0.026, 'train_loss': 0.0017334493079052577, 'epoch': 0.5}

100%|██████████| 287/287 [3:03:27<00:00, 55.39s/it]
100%|██████████| 287/287 [3:03:27<00:00, 38.35s/it]
wandb: 
wandb: 🚀 View run gen_mix_math_7b at: https://wandb.ai/kolerk/huggingface/runs/30tmzupd
wandb: Find logs at: wandb/run-20250511_194142-30tmzupd/logs
[rank0]:[W511 22:46:02.616050848 ProcessGroupNCCL.cpp:1250] Warning: WARNING: process group has NOT been destroyed before we destruct ProcessGroupNCCL. On normal program exit, the application should call destroy_process_group to ensure that any pending NCCL operations have finished in this process. In rare cases this process can exit before this point and block the progress of another member of the process group. This constraint has always been present,  but this warning has only been added since PyTorch 2.4 (function operator())