Last Updated on 2024-09-29 by Clay
Ripgrep (rg) is a command-line tool used for quickly searching file contents, designed as a replacement for grep, addressing grep's efficiency issues with large-scale file searches.
Last Updated on 2024-09-28 by Clay
man is the traditional documentation tool for UNIX/Linux systems, but the detailed nature of its output can be overwhelming for users who just want a quick reference on how to use a command. Therefore, a simplified version called tldr was created (short for "too long, didn't read"). It focuses on providing concise, easy-to-understand command documentation.
Last Updated on 2024-09-27 by Clay
I've been looking for a more visually appealing alternative to htop for a long time. A few years ago, during a gathering with friends, I happened to pull out my laptop to fix a docker segmentation fault issue in the lab. One of my friends saw my htop and remarked, "So primitive~ Engineers are so boring~" I still hold a grudge for that (just kidding, of course).
Last Updated on 2024-09-26 by Clay
viddy is a tool similar to watch for running a command at regular intervals in a Linux terminal and displaying the output.
Last Updated on 2024-09-25 by Clay
In the process of training and fine-tuning deep neural networks, the most important and scarce resource is undoubtedly the GPU's VRAM. Therefore, making every bit perform at its best is a critical task.
Read More »Differences in Precision Representations in Deep Learning: Float32, Float16, Float8, and BFloat16Last Updated on 2024-09-19 by Clay
Linux has so many useful tools, and I truly want to document every single one of them. To celebrate Linux reaching a usage rate of 4.55% on StatCounter (2024-09-18), I've decided to document another tool recommended by a colleague—the fuck command.
Last Updated on 2024-09-17 by Clay
z command is something I've wanted to write about for a long time! However, I've been busy with AI training (company work) and model acceleration (personal interest), so I haven't had the time. Let's put it this way, if someone asks me to recommend essential tools for a Linux system, I would undoubtedly place z in my top ten list.
Last Updated on 2024-09-15 by Clay
In the FastAPI official documentation, there's a section about 'Automatic Interactive API Documentation':
Last Updated on 2024-09-14 by Clay
Recently, I've achieved some good application results by fine-tuning Gemma-2. However, I encountered various errors when deploying it on the client's equipment, which was quite frustrating. Currently, there isn't a systematic troubleshooting guide online, so I'm documenting it here.
Read More »Troubleshooting Accelerated Inference of Gemma-2 on V100 GPUs Using vLLM
Last Updated on 2024-09-12 by Clay
In Python, the context manager decorator @contextmanager from the contextlib module allows developers to conveniently create our own context manager.
