Hi,
The point of checkpointing is to take multiple operations and remove the buffers between them.
If you checkpoint a single operation (like just a relu), it will have no effect but slow down your process.
You want to either checkpoint a conv + relu block? Or even all yours convs together?