This is a strange error message:
RuntimeError: Attempting to deserialize object on CUDA
device 3 but torch.cuda.device_count() is 1.Today I want to record a common problem, its solution is very rarely. Simple to put, the error message as follow:
RuntimeError: CUDA out of memory. Tried to allocate 2.0 GiB.When I use PyTorch to build a model, I often feel at a loss as to how to add the data to the end of the sequence when processing the data.
Read More »[PyTorch] Use torch.cat() To Replace The append() Operation In The List Data When Processing torch TensorIt is very convenient for building a model using the PyTorch framework. Today I want to introduce how to print out the model architecture and extract the model layer weights.
Read More »[PyTorch] How To Print Model Architecture And Extract Model WeightsToday when I using nn.Embedding in PyTorch, because I used it by mistake, the following error occurred:
GRU (Gate Recurrent Unit), I am not sure whether there is a Chinese translate of its name. Like LSTM, it is a variant of RNN (Recurrent Neural Network), and like LSTM, it aims to solve the gradient problem in RNN.
Read More »Graphical Introduction Note About GRU
LSTM (Long Short-Term Memory), is a type of Recurrent Neural Network (RNN). The paper about LSTM was published in 1997, which is a very important and easy-to-use model layer in natural language processing.
Read More »[PyTorch] LSTM Principle and Input and Output Format RecordEmbedding in the field of NLP usually refers to the action of converting text to numerical value. After all, text is discontinuous data and it can not be processed by computer.
Read More »[PyTorch] Use "Embedding" Layer To Process TextToday I got an error message as following (In a team project source code):
IndexError: Dimension out of range (expected to be in range of [-1, 0], but got 1)
Today, I record some of my own experience in solving data imbalance problem of training model here. It may not be enough for the proficient and expert to refer to, but I hope it can help those who are still unclear on how to do it.
Read More »[PyTorch] Give Different Loss Weights for Different Classification results to Solve the Problem of Data Imbalance