Solved by ptrblck in post #4 
              
              
                The complete input batch will be used and you don’t have to specify the batch size in any layer arguments, such as the number of input features etc.