OFD distiller with ResNet50 - MobileNetV2 architectures does not work.

[HyunJunSik]

Hello

I have a question about that OFD distiller does not work in ResNet50 - MobileNetV2 architectures.

So, I analyzed MobileNetV2 in scratch.

Then, I found that MobileNetV2 does not have "preact_feat" outputs.

In OFD distiller, it compute with teacher and student's preact_feats.

So I want to clarify that how you train MobileNetV2 - ResNet50 architecture with OFD?

Does you added preact_feats in mobilenetv2?

Thank you very much.