In early 2023, The pytorch 2.0 version added a new function that is torch.compile(), It cloud be accelerate the speed of model training or inference. By using precision training with compiling, it always make my training time reduce to half.
Today I tried to load the model weights file after torch.compile(), and then I found the weights is stored by OrderedDict data structure. This data structure is an ordered sequence, in other word its content needs to follow the order.
Neo4j is a graph database. Unlike traditional databases, the focus of a graph database is the "graph", which means the relationships and connections between nodes (entities). Each node can represent an object (such as people, things, places...), and edges represent the relationships between nodes (such as friends, owns, located at...)
Read More »Installation Of Neo4j Graph Database And Use It By Python yield is a keyword in Python, utilized much like return, the use of yield transforms a function into a Generator.
FastAPI is a modern, high-performance Python web framework. It is based on Python 3.7+ and utilizes Python type hints.
Read More »[Python] Notes on Backend Development Using the FastAPI Framework Recently, I trace many codes about LLaMA LoRA training (almost two months ago...), and when I reading the codes, I found if they want to configure the prompt for LLMs, if they need to change the prompt content by different training, the format_map() function is the best choice.
Moderation endpoint is a free tool that developed by OpenAI. It is design for detecting "Not Mode-rational Content" or "Sensitive Content". The more detailed list you can refer https://openai.com/policies/usage-policies.
Read More »Using OpenAI Moderation Endpoint To Dectect Not Moderation Content As project development plans become increasingly concerned with execution speed and memory usage, it is clearly necessary for us to understand how much memory the variables and objects use in the program.
Read More »[Python] How To Compute The Memory Usage of Variables And Objects
You are given two non-empty linked lists representing two non-negative integers. The digits are stored in reverse order, and each of their nodes contains a single digit. Add the two numbers and return the sum as a linked list.
You may assume the two numbers do not contain any leading zero, except the number 0 itself.