Hello, Can anyone help me to convert this Keras model to pytorch.
model_in =Input(shape=(None,1024))

x = Dense(512, kernel_initializer='glorot_uniform', bias_initializer='zeros')(model_in)

x = Activation('sigmoid')(x)

x = Dropout(0.8)(x)

x = Dense(1, kernel_initializer='glorot_uniform', bias_initializer='zeros')(x)

att_weights = Activation('sigmoid')(x) 

att_mull = Multiply()([model_in,att_weights])

mean = Lambda(lambda x:K.mean(x,axis=1))(att_mull)