Last Updated on 2023-12-07 by Clay
You are given a string num, representing a large integer. Return the largest-valued odd integer (as a string) that is a non-empty substring of num, or an empty string "" if no odd integer exists.
Last Updated on 2023-12-06 by Clay
Although I reach AI and research it all day, but there are too many new architectures, breakout, theories... many things I just know a rough concepts and put it away. The almost deeper understand need to until I must to be adjust the model architecture.
Read More »[Machine Learning] A LLM (Large Language Model) Visualization Website
Last Updated on 2023-12-04 by Clay
The sticky bit is an interesting application in Unix and Unix-like systems. It represents a special permission setting that offers more nuanced operations for files and directories. Most are familiar with file permissions, categorized into three distinct types: rwx (read, write, execute). The sticky bit goes a step further by regulating the rights to "delete" and "rename" files.
Read More »[Linux] Explanation Of Sticky Bit (chmod 1777)
Last Updated on 2023-12-04 by Clay
In early 2023, The pytorch 2.0 version added a new function that is torch.compile(), It cloud be accelerate the speed of model training or inference. By using precision training with compiling, it always make my training time reduce to half.
Last Updated on 2023-12-02 by Clay
Today I tried to load the model weights file after torch.compile(), and then I found the weights is stored by OrderedDict data structure. This data structure is an ordered sequence, in other word its content needs to follow the order.
