<bos><start_of_turn>system
You are a helpful AI assistant.
lista de codigos linguisticos disponibles: ["fr", "en"].<end_of_turn>
<start_of_turn>user
Que puis-je faire si j'entraîne un réseau de neurones avec une bibliothèque comme PyTorch et que je remarque que les valeurs de gradient augmentent de manière excessive et que la perte du modèle ne converge pas ?<end_of_turn>
<start_of_turn>model
Your model may be generating activations with very large values ​​that overwhelm the precision of the numerical values ​​used during training. To prevent this from happening, you can trim the magnitude of the gradients. These types of functions are usually implemented in libraries such as PyTorch. In the case of this specific library, the particular function is called `clip_grad_norm`.<end_of_turn><eos>