Machine Learning

[Solved] HuggingFace Transformers Model Return "'ValueError: too many values to unpack (expected 2)', upon training a Bert binary classification model"

Clay
2022-08-182022-08-18
Machine Learning, Python

In the current deep learning framework, whether using Tensorflow, PyTorch or others... the input and output of the model, the flow of data, we need to pay great attention to the shape of data. Because if you are not careful, the model will return an error message.

Clay
2022-08-092022-08-09
Machine Learning, NLP, Python

Today I used transformers package to build an ALBERT model to process a NLP task in the offline environment, and I got an error message when loading the ALBERT tokenizer:

Clay
2022-08-082022-08-08
Machine Learning, NLP, Python

Problem

Today I was testing the simpletransformers that is a well-known python deep learning package. But on my notebook, my training was stuck and not continue.

Clay
2022-08-042022-08-04
Machine Learning, Python

In the data processing, sometimes we want to replace some column values into others. It may be missing value, or the wrong value..., of course, python have many tools, packages, functions can do the replacement tasks.

Problem

Today I trained the model with simpletransformers package, I got an warning message that never seen:

Clay
2022-07-272022-07-27
Machine Learning

Kaggle Notebook offers a not-so-short GPU-acceleration time every week, and updated every Saturday. Because of this, I recommend using Kaggle Notebook over Google Colab.

Clay
2022-07-232022-07-23
Machine Learning, PyTorch

PyTorch Lightning is a framework that encapsulates native PyTorch in a more advanced level, just like Keras does to Tensorflow (although I remember a lot of backends that Keras can support).

Clay
2022-07-132022-07-13
Machine Learning, Python, PyTorch

I have always wanted to be able to save the optimizer used by PyTorch to train the model, so that can continue training after the model finishes the previous training.

Clay
2021-12-312021-12-31
Machine Learning, NLP, Python

aitextgen is a great Python pacakge, it allows user just need to write a few codes to configure the complex AI model. Its architecture is used OpenAI's GPT-2 and EleutherAI's GPT Neo/GPT-3, and it can receive pre-trained model to fine-tune.

Clay
2021-11-242021-11-24
Machine Learning, Python, PyTorch

Mean Absolute Error (MAE) is a standard and famous evaluation metric, it usually appears in the first class or the Nth class of the machine learning course... it depends on how your teacher arranges the textbook. But to me, it's like Mario's first mushroom monster after starting level 1-1.

« Previous
1
…
6
7
8
9
10
…
16
Next »

Machine Learning

[Solved] HuggingFace Transformers Model Return "'ValueError: too many values to unpack (expected 2)', upon training a Bert binary classification model"

[Solved] "TypeError: not a string" at Using AutoTokenizer.from_pretrained()

[Solved] Simpletransformers Stuck at Training And Not Continue

Problem

[Python] How To Replace The Value Of Pandas DataFrame

[Solved] huggingface/tokenizers: The current process just got forked. after parallelism has already been used. Disabling parallelism to avoid deadlocks

Problem

[Machine Learning] Continuously Train the Model on Kaggle Notebook (Can Close the Session)

[Machine Learning] Introduction of 'pytorch-lightning' package

[PyTorch] Save the Optimizer to Continue Training the Model

[NLP] Use aitextgen Python Package To Generate Text

[Machine Learning] Introduction To MAE Metric (With Example)