Last Updated on 2023-12-04 by Clay
In early 2023, The pytorch 2.0 version added a new function that is torch.compile(), It cloud be accelerate the speed of model training or inference. By using precision training with compiling, it always make my training time reduce to half.
Last Updated on 2023-12-02 by Clay
Today I tried to load the model weights file after torch.compile(), and then I found the weights is stored by OrderedDict data structure. This data structure is an ordered sequence, in other word its content needs to follow the order.
Last Updated on 2023-11-27 by Clay
Neo4j is a graph database. Unlike traditional databases, the focus of a graph database is the “graph”, which means the relationships and connections between nodes (entities). Each node can represent an object (such as people, things, places…), and edges represent the relationships between nodes (such as friends, owns, located at…)
Read More »Installation Of Neo4j Graph Database And Use It By Python
Last Updated on 2023-11-20 by Clay
Although Linux is reputed to be less susceptible to viruses distributed by hackers, it still remains a highly valuable and economically efficient operating system, particularly as a stable server or development environment. Consequently, Linux is not immune to malware or hacker attacks, albeit less frequent than in Windows systems.
Read More »[Linux] Installation And Use Of Open Source Anti-virus Tool: ClamAVLast Updated on 2023-12-10 by Clay
Swap space plays an important role in Linux operating systems. It can be understood as a virtual memory space, where its name implies the act of swapping. Swap allows for temporarily writing less frequently used data to a fixed hard disk space to ensure stable system operation when the physical memory (RAM) is insufficient — this space is Swap.
Read More »[Linux] Increase Swap Space Using Commands to Prevent Memory ExhaustionLast Updated on 2023-07-11 by Clay
yield is a keyword in Python, utilized much like return, the use of yield transforms a function into a Generator.
Last Updated on 2023-07-03 by Clay
FastAPI is a modern, high-performance Python web framework. It is based on Python 3.7+ and utilizes Python type hints.
Read More »[Python] Notes on Backend Development Using the FastAPI FrameworkLast Updated on 2023-06-29 by Clay
duf is a tool that offers a more “graphical representation” for checking disk space usage on Linux systems, with its name derived from Disk Usage/Free Utility. It’s worth mentioning that this tool can also be installed not only on Linux but also on MacOS and Windows.
Last Updated on 2023-06-28 by Clay
In the midst of exploring various AI models, perhaps owing to a habit cultivated during my time in research institutes, I find myself invariably sifting through research papers pertinent to the models, systems, or libraries I’m working on.
Read More »Consensus: Harnessing AI-Powered Engines for Streamlined Research Paper SearchesLast Updated on 2023-06-27 by Clay
Recently, I trace many codes about LLaMA LoRA training (almost two months ago…), and when I reading the codes, I found if they want to configure the prompt for LLMs, if they need to change the prompt content by different training, the format_map() function is the best choice.
