I was tracing back the objectdetection object in the repository of the API. Maybe it was luck, but I found out how to get the object detection layers at least the Prediction head:
detection_model._box_predictor._prediction_heads[‘class_predictions_with_background’]._class_predictor_layers[0]
Hopefully helps