[PyTorch] Use "random_split()" Function To Split Data Set
If we have a need to split our data set for deep learning, we can use PyTorch built-in data split function random_split() to split our data for dataset.
Machine Learning
[PyTorch] Set Seed To Reproduce Model Training Results
PyTorch is a famous deep learning framework. As you can see from the name, it is called using Python syntax.
Read More »[PyTorch] Set Seed To Reproduce Model Training Results
[Solved] FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint8 = np.dtype([("qint8", np.int8, 1)])
Tensorflow can be said to be the most well-known among the many deep learning framework, but when I use Keras/Tensorflow, I often encounter the following FutureWarning about the Numpy version:
Read More »[Solved] FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint8 = np.dtype([("qint8", np.int8, 1)])
[PyTorch] How To Use `squeeze()` and `unsqueeze()` Functions
When I first started using the PyTorch framework to gradually learn how to build models, I read and executed many examples from the official tutorials. At that time, I often encountered functions like squeeze() and unsqueeze() in example code, but I didn't quite understand their purposes.
[PyTorch] Use view() and permute() To Change Dimension Shape
PyTorch a is deep learning framework based on Python, we can use the module and function in PyTorch to simple implement the model architecture we want.
Read More »[PyTorch] Use view() and permute() To Change Dimension Shape
[NLP] The TF-IDF In Text Mining
TF-IDF (Term Frequency - Inverse Document Frequency) is a famous word weighting technology, it can show the importance of words to texts.
Read More »[NLP] The TF-IDF In Text Mining
[Python] Use ShuffleSplit() To Process Cross-Validation Step
Cross-validation is an important concept in data splitting of machine learning. Simply to put, when we want to train a model, we need to split data to training data and testing data.
Read More »[Python] Use ShuffleSplit() To Process Cross-Validation Step[PyTorch] How To Use pad_packed_sequence() And pack_padded_sequence() To Adjust Sequence Length
When we use RNN network (such as LSTM and GRU), we can use Embedding layer provided from PyTorch, and receive many different length sequence sentence input.
Read More »[PyTorch] How To Use pad_packed_sequence() And pack_padded_sequence() To Adjust Sequence Length[Solved][PyTorch] TypeError: expected Tensor as element 0 in argument 0, but got list
Problem
Today, when I was trying to use nn.Embedding() to splice and calculate sentence vectors by myself, I got an error like this on the DataLoader I prepared in advance:
[PyTorch] Use nn.Embedding() To Load Gensim Pre-trained Model Weight
If you are using PyTorch to processing NLP tasks, you must be familiar with nn.Embedding() in PyTorch.