Question: I am running a pipeline using the Apache Beam model in Google Cloud Dataflow but I am unable to scale it up from 8 workers, even though the maximum number of workers is 32. 

When I try to run the same pipeline setting the number of workers to 32, it gives me the following warnings:

`Autoscaling: Startup of the worker pool in zone us-central1-f reached 30 workers, but the goal was 32 workers. The service will retry. QUOTA_EXCEEDED: Quota 'DISKS_TOTAL_GB' exceeded. Limit: 4096.0`

`Autoscaling: Unable to reach resize target in zone us-central1-f. QUOTA_EXCEEDED: Quota 'DISKS_TOTAL_GB' exceeded. Limit: 4096.0`

But still doesn't pass 8 workers. Is there any particular reasons why a pipeline won't use more than 8 workers?

Answer: 
1. Visit <https://console.cloud.google.com/iam-admin/quotas>
2. Use the filter menu that says Quota type 

[![enter image description here](https://i.stack.imgur.com/LmBxT.png)](https://i.stack.imgur.com/LmBxT.png)
3. You can tell by the color of the Current Usage column that API limit has reached limit.
4. Click **Edit Quotas** for the API that has exceeded usage and request for new limit. This will take from few hours to day.
Dataflow will use whatever number of workers you can get. In your case, it will reach 30 workers and will use them. It will however retry constantly to reach 32, as quota could be given back by other workflows.