Skip to content

December 3, 2023

[Solved][PyTorch] Model State Dict Files Have The "_orig_mod" Prefix After Compiling

Last Updated on 2023-12-04 by Clay

Problem

In early 2023, The pytorch 2.0 version added a new function that is torch.compile(), It cloud be accelerate the speed of model training or inference. By using precision training with compiling, it always make my training time reduce to half.

Read More »[Solved][PyTorch] Model State Dict Files Have The "_orig_mod" Prefix After Compiling