Southern India remained independent , but Ashoka had his hands full with a large empire that now extended as far north as Kashmir and east to Bengal .
Ashoka 's forces retreated under attacks from all sides as his empire shrunk .