Based on what you have shared, I need some more details to attempt to help you figure things out;

What type of loss function are you using?
Which optimization method are you using, and what are its hyperparameters?
How big is your training dataset?
How long are you training for, i.e. how many epochs?
Are you using any type of learning rate scheduling, early stopping, or similar?