Fine tuning from specific layer number

Is there a way where we can specify a specific layer number and start training specific layers with BIT using tensorflow. Currently number of layers it shows 2 and when I specify the layer number accuracy drops to single digit. Looks like its training from scratch. Looking for a correct way to fine tune