Clay

Use `snapshot_download` To Download The Models Of HuggingFace Hub

Clay
2024-07-222024-07-22
Linux, Machine Learning, Python

Introduction

HuggingFace Model Hub is now a widely recognized and essential open-source platform for every one. Every day, countless individuals and organizations upload their latest trained models (including those for text, images, speech, and other domains) to this platform. It can be said that anyone working in AI-related fields frequently browses the HuggingFace platform website.

Clay
2024-07-212024-07-25
Machine Learning

Introduction

Mistral 7B is a large language model (LLM) proposed on September 27, 2023, trained by the Mistral AI team, which also released its weights as open source. Interestingly, it uses the highly permissive Apache 2.0 license, unlike Llama 2, which has its own Llama license terms. Therefore, Mistral 7B is truly "open source" (Llama's license requires discussion with Meta AI when the service volume reaches 700 million).

Clay
2024-07-202024-07-20
Machine Learning, Python

Introduction

Recently, I have been exploring models used for Optical Character Recognition (OCR). In the past, OCR was a very popular research field as it was one of the earliest practical applications of computer vision. Today, OCR has become a very mature task, and you can easily find high-performance open-source models online.

Clay
2024-07-102024-07-20
Machine Learning

Introduction

In today's era of flourishing large language models, researchers and companies are racking their brains to apply these models to their work. However, speaking personally, the performance of current language models is still not strong enough, and their application scenarios are limited, often far less than that of humans.

But there is one type of task for which large language models are naturally quite suitable: information extraction in any scenario, which is what I want to introduce today, the NuExtract model.

Clay
2024-06-062024-06-06
Machine Learning, PyTorch

Introduction

SiLU (Sigmoid Linear Unit) activation function is similar to Swish function, Swish just have additional trainable beta parameter. Many large language model (LLM) also adopt this approach, primarily in some exploratory models that use activation functions other than ReLU, such as the classic Llama architecture.

Clay
2024-06-042024-06-05
Machine Learning, Python

Introduction

For several months, I have benefited greatly from the Unsloth project, primarily because a significant part of my job involves fine-tuning large language models (LLMs). Fine-tuning LLMs is extremely time-consuming; aside from data collection, the biggest time sink is the endless GPU-powered fine-tuning process.

Clay
2024-06-032024-07-25
Machine Learning, Python

Introduction

The accelerated framework is proposed by Huawei Noah's Ark Lab, it replaces the small model used in the original speculative decoding with the shallow sub-network of the large model. Additionally, it employs an extra-trained adapter and the model’s own decoding head to generate speculative tokens, which are then verified by the large model. The subsequent operations are quite similar to the original speculative decoding process.

Clay
2024-06-022024-06-02
Linux, Python

Introduction

RESTful design (Representational State Transfer, REST) is an architectural style for designing network applications. It follows principles that make network applications simpler, more scalable, and easier to maintain.

Clay
2024-06-012024-06-01
Computer

Introduction

When assigning identifiers to our data, if we want each data to have a unique identifier rather than a simple sequential number, UUID is the most common method we used.

So, what is UUID?

Clay
2024-02-262024-02-26
Machine Learning

What is Prompt Injection Attack?

Prompt injection attacks are a burgeoning security concern, primarily targeting large language models (LLMs) or other AI-related domains.

« Previous
1
…
8
9
10
11
12
…
81
Next »

Clay

Use `snapshot_download` To Download The Models Of HuggingFace Hub

Introduction

[Paper Reading] Mistral 7B

Introduction

PaddleOCR: A Framework and Model Specialized in Chinese Optical Character Recognition (OCR)

Introduction

NuExtract: A Large Language Model For Information Extraction

Introduction

[Machine Learning] Note Of SiLU Activation Function

Introduction

Note Of Unsloth Accelerate Fine-tuning Open Source Project

Introduction

[Paper Reading] Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

Introduction

Note Of RESTful (With Python FastAPI + CURL Example)

Introduction

Note Of Universally Unique Identifier (UUID)

Introduction

Defense Note Against Prompt Injection Attack

What is Prompt Injection Attack?