Hi,
I would like to put multiple models into CPU memory with shared memory support. So that I can easily transfer models among multiple processes.
I am using code logic as following:
...
a_list_of_models = load_models()

for model in a_list_of_models:
    model.share_memory()
...

The code works fine with 4-5 models, but if I launched more models, I got RuntimeError: unable to open shared memory object.
I saw many other people have the same runtime error while using dataloader. While I am not using dataloader here, so I am not able to set the parameter num_worker to be 0.
I have also checked the shared memory limitation on my machine is unlimited. And the physical memory is more than enough to hold 100 models.
The most relevant topic is this one: How to configure shared memory size? 3
but, unfortunately, no answer there.
any suggestions?