Hi Thanks.
So here’s my output in pytorch:
(500L, 192L, 67L)
(500L, 192L, 67L)
(500L, 184L, 58L)
(500L, 184L, 58L)
(500L, 174L, 39L)
(500L, 174L, 39L)

The first dimension is batch-size, so you can simply ignore it. The duplicate one corresponds to relu.