Have you tried padding your call with extra (unused) batches?
If that doesn’t work, you may want to try padding and then taking a view of only the batches you’re using. Then pass that view to the Cholesky call.