Question: I want to load about 100 small tables (min 5 records, max 10000 records) from SQL Server into Google BigQuery on a daily basis. We have created 100 Datafusion pipelines, one pipeline per source table. When we start one pipeline it takes about 7 minutes to execute. Offcourse its starts DataProc, connects to SQL server and sinks the data into Google BigQuery. When we have to run this sequentially it will take 700 minutes? When we try to run in pipelines in parallel we are limited by the network range which would be 256/3. 1 pipeline starts 3 VM's one master 2 slaves. We tried but the performance is going down when we start more than 10 pipelines in parallel.
Questions. Is this the right approach?

Answer: 
the error was due to an incorrect version of the surefire plugin. I put the latest version 3.0.0-M5 and the error disappeared.
@andreoss thanks for the tip
You need to upgrade `maven-surefire-plugin`. This bug [SUREFIRE-1382](https://issues.apache.org/jira/browse/SUREFIRE-1382) has been fixed in 2.20.1