Thank you very much for your reply!
In the end it was just a stupid broadcasting error becuase i have to sum the bias gradients to counter the
batch size and i summed the weight gradients aswell.
have a nice day!