How did you execute the container?
Note that you would need the nvidia docker runtime to be able to use GPUs inside the container.
Older docker versions used:
nvidia-docker run container

while newer ones can be started via:
docker run --gpus all container