[Python] Creating and Auto-Removing Temporary Directories with Python's `tempfile`

Clay
2024-01-072024-01-07
Python

Last Updated on 2024-01-07 by Clay

Introduction

Today I was reading the training source code of DreamBooth, and I found the tempfile built-in module; I happened to reconstruct a script for model's layer merging, suddenly thought that the module would make the code more elegant, so I made this note.

Clay
2024-01-022024-01-02
Machine Learning, Python, PyTorch

Last Updated on 2024-01-02 by Clay

Introduction

DPO (Direct Preference Optimization) is a fine-tuning method that want to replace RLHF (Reinforcement Learning from Human Feedback).

Clay
2024-01-012024-01-02
Machine Learning, PyTorch

Last Updated on 2024-01-02 by Clay

Problem

HuggingFace has published an article stating that the current LLM is best trained according to the ChatML format. In normal case, it will be generated according to three different roles of system, user and assistant. The format is as follows:

Clay
2023-12-282023-12-28
Linux, Python

Last Updated on 2023-12-28 by Clay

Problem

Today I installed pyaudio on my new Linux laptop (a python package for sound recording), I encountered an error I never met:

Clay
2023-12-182023-12-18
Python

Last Updated on 2023-12-18 by Clay

Introduction

IPython is a system that provided a interactive interface, it could be integrated with shells or graphical interface; for example we can use ipython (if you had been installed it), or you can use some GUI editor/IDE such as VS Code and PyCharm.

Clay
2023-12-182023-12-18
C++, LeetCode, Python

LeetCode: 2352-Design a Food Rating System Solution

Clay
2023-12-172023-12-17
C++, LeetCode

Last Updated on 2023-12-17 by Clay

Problem

Design a food rating system that can do the following:

Modify the rating of a food item listed in the system.
Return the highest-rated food item for a type of cuisine in the system.

Clay
2023-12-162023-12-16
C++, LeetCode, Python

Last Updated on 2023-12-16 by Clay

Problem

Given two strings s and t, return true if t is an anagram of s, and false otherwise.

Clay
2023-12-152023-12-15
C++, LeetCode, Python

Last Updated on 2023-12-15 by Clay

Problem

You are given the array paths, where paths[i] = [cityA_i, cityB_i] means there exists a direct path going from cityA_i to cityB_i. Return the destination city, that is, the city without any path outgoing to another city.

Clay
2023-12-142023-12-14
Machine Learning, Python, PyTorch

Last Updated on 2023-12-14 by Clay

Introduction

vLLM is a large language model (LLM) acceleration framework that developed by the research team of University of California, Berkeley. It is used PagedAttention to increase the usage rate of GPU VRAM, and this method do not change the model architecture.

« Previous
1
…
10
11
12
13
14
…
81
Next »

[Python] Creating and Auto-Removing Temporary Directories with Python's `tempfile`