Data Science, Machine Learning.
(submat.data, submat.indices, submat.indptr), (current_chunk_size, cols))) i += current_chunk_size return sc.parallelize(submatrices) You’d notice that after the broadcast and parallelize, we re-assemble the matrix into scipy csr_matrix, which is what it originated from. So what we basically do is