It might be useful to check at which layer the output of the sequential module stops making sense. Can you try starting from a single layer in the sequential module, inspecting the output (e.g., just printing the output tensor), and adding more layers progressively?