The so-called Neural Network is the model architecture we want to build for deep learning. In official PyTorch document, the first sentence clearly states:
You can use torch.nn to build a neural network.
I believe everyone who is familiar with deep learning knows the importance of automatic derivation. In here, I will make a simple record.
The neural network operation of the deep learning model includes forward propagation and backward propagation.
Read More »[PyTorch] Tutorial(2) Automatic derivative I have been studying about pointer-generator network lately, and I found a package “pkbar“can let us to use keras style progress bar in our tasks.
In fact, it can be used not only in the code of PyTorch framework but also in any loop.
Read More »[PyTorch] A progress bar using Keras style: pkbar
Today when I reading the document of the “Transformers” package which Hugging Face developed, I suddenly discovered the model I build, its state is “eval()”, not “train()”. It seems that as long as we use “from_pretrained()” method is the default state “eval()”.
Read More »[PyTorch] How to check the model state is “train()” or “eval()” This is very common error message in PyTorch.
RuntimeError: bool value of Tensor with more than one value is ambiguousWhen I using PyTorch to train a model, I often use GPU_A to train the model, save model. But if I load the model I saved to test some new data, I always put the new data in a different GPU, we called it GPU_B.
Read More »[PyTorch] How to check which GPU device our data used When we using the famous Python framework: PyTorch, to build our model, if we can visualize our model, that’s a cool idea.
In this way, we can check our model layer, output shape, and avoid our model mismatch.
Read More »[PyTorch] Using “torchsummary” to plot your model structure I think if we use Pytorch framework to train a model, the commonly error messages are “Model mismatch” and the following error:
Read More »[Solved][PyTorch] RuntimeError: Expected object of scalar type Float but got scalar type Long for argument Today, when I using PyTorch to build a LSTM model, I got an error occured:
LSTM RuntimeError: input must have 3 dimensions, got 2Today, when I load a model I trained with PyTorch and I want to use it to process some new data, I got a error report:
Read More »[Solved] RuntimeError: Input and parameter tensors are not at the same device, found input tensor at cpu and parameter tensor at cuda:0