Solved by KyleOng in post #5 
              
              
                I see. After googling for awhile, I thought the solution might be something like this 
(How to add new nodes at the last layer (fully connected layer)? - #4 by MariosOreo), 
where we pad the old model input weights to the shape of the new model input weights with random values and then load_state_di…