Thank you. It was just because the instructions I was following on the pytorch website said to have the kernel invocation in the cpp file instead of the cu file. But just having the entire thing in the cu file seems to work just fine.