How to freeze tensorflow graph partly?

You can firstly save your existing model, after that, you can change your model architecture in your code, then load only that part from your checkpoint. Tensorflow lets you load only some part of the model. After loading you will have partly graph in the session, you can save it into pb file.