batcat or simply bat, is a replacement tool for the cat command. It retains the functionality of cat for displaying files, while also highlighting keywords in code or configuration files, making it more convenient for developers to browse daily tasks or code files (thus, it’s definitely a productivity tool!).
Ripgrep (rg) is a command-line tool used for quickly searching file contents, designed as a replacement for grep, addressing grep‘s efficiency issues with large-scale file searches.
man is the traditional documentation tool for UNIX/Linux systems, but the detailed nature of its output can be overwhelming for users who just want a quick reference on how to use a command. Therefore, a simplified version called tldr was created (short for “too long, didn’t read”). It focuses on providing concise, easy-to-understand command documentation.
I’ve been looking for a more visually appealing alternative to htop for a long time. A few years ago, during a gathering with friends, I happened to pull out my laptop to fix a docker segmentation fault issue in the lab. One of my friends saw my htop and remarked, “So primitive~ Engineers are so boring~” I still hold a grudge for that (just kidding, of course).
viddy is a tool similar to watch for running a command at regular intervals in a Linux terminal and displaying the output.
In the process of training and fine-tuning deep neural networks, the most important and scarce resource is undoubtedly the GPU’s VRAM. Therefore, making every bit perform at its best is a critical task.
Read More »Differences in Precision Representations in Deep Learning: Float32, Float16, Float8, and BFloat16Linux has so many useful tools, and I truly want to document every single one of them. To celebrate Linux reaching a usage rate of 4.55% on StatCounter (2024-09-18), I’ve decided to document another tool recommended by a colleague—the fuck command.
z command is something I’ve wanted to write about for a long time! However, I’ve been busy with AI training (company work) and model acceleration (personal interest), so I haven’t had the time. Let’s put it this way, if someone asks me to recommend essential tools for a Linux system, I would undoubtedly place z in my top ten list.
In the FastAPI official documentation, there’s a section about ‘Automatic Interactive API Documentation‘:
Recently, I’ve achieved some good application results by fine-tuning Gemma-2. However, I encountered various errors when deploying it on the client’s equipment, which was quite frustrating. Currently, there isn’t a systematic troubleshooting guide online, so I’m documenting it here.
Read More »Troubleshooting Accelerated Inference of Gemma-2 on V100 GPUs Using vLLM
