No, don't worry, deleting the cache partition will not affect your personal data or apps. It only clears out temporary files that can sometimes cause issues.
Alright, I did it. But now my phone is asking me to restart it again.