Machine Learning
[Machine Learning] CodeBERT Introduction (With Example)
Introduction
CodeBERT is a pre-trained model based on transformer architecture, it is proposed from CodeBERT: A Pre-Trained Model for Programming and Natural Languages.
Read More »[Machine Learning] CodeBERT Introduction (With Example)[PyTorch] How to Use HuggingFace Transformers Package (With BERT Example)
At the end of 2018, the transformer model BERT occupied the rankings of major NLP competitions, and performed quite well. I have been interested in transform models such as BERT, so today I started to record how to use the transformers package developed by HuggingFace.
Read More »[PyTorch] How to Use HuggingFace Transformers Package (With BERT Example)[Solved] Exception ignored in: bound method BaseSession.__del__ of tensorflow.python.client.session.Session object at 0x7ff1243e0358
Problem
Today when I running a Keras program with Tensorflow backend, the following error message unexpectedly occurred:
Read More »[Solved] Exception ignored in: bound method BaseSession.__del__ of tensorflow.python.client.session.Session object at 0x7ff1243e0358[ML] How To Install Weka: A ML Tool For Data Mining
In the past I have no any experience of Weka, but in the meeting of fate, I came into contact with Weka that a tool suitable for data mining and machine learning, so I simply recorded how to install it here.
Read More »[ML] How To Install Weka: A ML Tool For Data Mining[Deep Learning] Build The Tensorflow, CUDA And cuDNN Environment on Windows
Building a deep learning environment is not an easy task, especially the combination of Nvidia GPU and Tensorflow. The version problems and the driver, CUDA and cuDNN that need to be installed are enough to cause headaches. Moreover, the mainstream operating system is Linux instead of Windows, and it can be found that there are obvious tutorial article.
Read More »[Deep Learning] Build The Tensorflow, CUDA And cuDNN Environment on Windows[PyTorch] Use Early Stopping To Stop Model Training At A Better Convergence Time
Early stopping is a technique applied to machine learning and deep learning, just as it means: early stopping. In the process of supervised learning, this is likely to be a way to find the time point for the model to converge.
Read More »[PyTorch] Use Early Stopping To Stop Model Training At A Better Convergence Time[PyTorch] Use "random_split()" Function To Split Data Set
If we have a need to split our data set for deep learning, we can use PyTorch built-in data split function random_split()
to split our data for dataset.
[PyTorch] Set Seed To Reproduce Model Training Results
PyTorch is a famous deep learning framework. As you can see from the name, it is called using Python syntax.
Read More »[PyTorch] Set Seed To Reproduce Model Training Results[Solved] FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint8 = np.dtype([("qint8", np.int8, 1)])
Tensorflow can be said to be the most well-known among the many deep learning framework, but when I use Keras/Tensorflow, I often encounter the following FutureWarning about the Numpy version:
Read More »[Solved] FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint8 = np.dtype([("qint8", np.int8, 1)])