[Solved][PyTorch] Model State Dict Files Have The "_orig_mod" Prefix After Compiling
Last Updated on 2023-12-04 by Clay
Problem
In early 2023, The pytorch 2.0 version added a new function that is torch.compile()
, It cloud be accelerate the speed of model training or inference. By using precision training with compiling, it always make my training time reduce to half.