Could we do the following?

Run LowerGraph pass: This pass will return a new Graph and a list of tensors.
Add these Tensors as constants in the graph and remove the corresponding Graph input from the graph. Replace all the input’s references with the constants references.
Create a module from this graph.

Is this a valid approach?
This will create a graph whose inputs are only the original model’s inputs.