pierreguillou:

How we can get them DURING the training?


You find them in the AWS Management console at the SageMaker Service → Training → Training job → Details View. Or you can use SageMaker Studio to inspect those. AWS Blog post

Problem: “Warning: No metrics called eval_loss found”

If you are using metrics_definitions sagemaker is scanning the stdout based on the regex schemes defined in metrics_definitions the scheme doesn’t match the output I cannot find any. So I guess for run_ner.py you might need to adjust the metrics_definitions regex scheme. Here is more documentation for that: Define Metrics - Amazon SageMaker