Python

[Solved][PyTorch] Model State Dict Files Have The "_orig_mod" Prefix After Compiling

Clay
2023-12-032023-12-04
Machine Learning, Python, PyTorch

Problem

In early 2023, The pytorch 2.0 version added a new function that is torch.compile(), It cloud be accelerate the speed of model training or inference. By using precision training with compiling, it always make my training time reduce to half.

Clay
2023-12-022023-12-02
Python

Problem

Today I tried to load the model weights file after torch.compile(), and then I found the weights is stored by OrderedDict data structure. This data structure is an ordered sequence, in other word its content needs to follow the order.

Clay
2023-11-272023-11-27
Database

Introduction

Neo4j is a graph database. Unlike traditional databases, the focus of a graph database is the "graph", which means the relationships and connections between nodes (entities). Each node can represent an object (such as people, things, places...), and edges represent the relationships between nodes (such as friends, owns, located at...)

Clay
2023-07-112023-07-11
Python

Introduction

yield is a keyword in Python, utilized much like return, the use of yield transforms a function into a Generator.

Clay
2023-07-032023-07-03
Python

Introduction

FastAPI is a modern, high-performance Python web framework. It is based on Python 3.7+ and utilizes Python type hints.

Clay
2023-06-272023-06-27
Python

Recently, I trace many codes about LLaMA LoRA training (almost two months ago...), and when I reading the codes, I found if they want to configure the prompt for LLMs, if they need to change the prompt content by different training, the format_map() function is the best choice.

Clay
2023-06-152023-06-15
Machine Learning

Introduction

Moderation endpoint is a free tool that developed by OpenAI. It is design for detecting "Not Mode-rational Content" or "Sensitive Content". The more detailed list you can refer https://openai.com/policies/usage-policies.

Clay
2022-12-102022-12-10
Python

As project development plans become increasingly concerned with execution speed and memory usage, it is clearly necessary for us to understand how much memory the variables and objects use in the program.

Clay
2022-09-192022-09-19
C++, LeetCode, Python

Problem

Clay
2022-09-142022-09-19
C++, LeetCode, Python

Problem

You are given two non-empty linked lists representing two non-negative integers. The digits are stored in reverse order, and each of their nodes contains a single digit. Add the two numbers and return the sum as a linked list.

You may assume the two numbers do not contain any leading zero, except the number 0 itself.

« Previous
1
…
3
4
5
6
7
…
32
Next »

M	T	W	T	F	S	S
				1	2	3
4	5	6	7	8	9	10
11	12	13	14	15	16	17
18	19	20	21	22	23	24
25	26	27	28	29	30

Python

[Solved][PyTorch] Model State Dict Files Have The "_orig_mod" Prefix After Compiling

Problem

[Solved] RuntimeError: OrderedDict mutated during iteration - OrderedDict Could Not Changed

Problem

Installation Of Neo4j Graph Database And Use It By Python

Introduction

[Python] yield and Generator

Introduction

[Python] Notes on Backend Development Using the FastAPI Framework

Introduction

[Python] Use format_map() To Fill Variable Values In The String

Using OpenAI Moderation Endpoint To Dectect Not Moderation Content

Introduction

[Python] How To Compute The Memory Usage of Variables And Objects

LeetCode: 1022-Sum of Root To Leaf Binary Numbers Solution

Problem

LeetCode: 2-Add Two Numbers Solution

Problem