This year, due to work, I tried annotating the data myself; it was only after diving into it personally that I truly understood just how profoundly training data affects an AI model.
Read More »"Common sense, as people call it, is merely the biases learned during youth"—the training data for AI models is no different
Recently, while handling some work-related matters, I noticed that the client might potentially need a way to extract text from PPT files. I discussed this with the PM and my supervisor, and they mentioned that the client could simply copy the text from the PPT slides manually. Unless the client explicitly requests us to extract it programmatically.
Read More »[Python] Extracting Text from PPT Using the python-pptx Library
The first time I heard about Vector Quantization (VQ) was from a friend who was working on audio processing, which gave me a vague understanding that VQ is a technique used for data feature compression and representation. At that time, I still wasn't clear on how it differed from dimensionality reduction techniques like PCA.
Read More »[Machine Learning] Vector Quantization (VQ) Notes
batcat or simply bat, is a replacement tool for the cat command. It retains the functionality of cat for displaying files, while also highlighting keywords in code or configuration files, making it more convenient for developers to browse daily tasks or code files (thus, it's definitely a productivity tool!).
Ripgrep (rg) is a command-line tool used for quickly searching file contents, designed as a replacement for grep, addressing grep's efficiency issues with large-scale file searches.
man is the traditional documentation tool for UNIX/Linux systems, but the detailed nature of its output can be overwhelming for users who just want a quick reference on how to use a command. Therefore, a simplified version called tldr was created (short for "too long, didn't read"). It focuses on providing concise, easy-to-understand command documentation.
I've been looking for a more visually appealing alternative to htop for a long time. A few years ago, during a gathering with friends, I happened to pull out my laptop to fix a docker segmentation fault issue in the lab. One of my friends saw my htop and remarked, "So primitive~ Engineers are so boring~" I still hold a grudge for that (just kidding, of course).
viddy is a tool similar to watch for running a command at regular intervals in a Linux terminal and displaying the output.
In the process of training and fine-tuning deep neural networks, the most important and scarce resource is undoubtedly the GPU's VRAM. Therefore, making every bit perform at its best is a critical task.
Read More »Differences in Precision Representations in Deep Learning: Float32, Float16, Float8, and BFloat16 Linux has so many useful tools, and I truly want to document every single one of them. To celebrate Linux reaching a usage rate of 4.55% on StatCounter (2024-09-18), I've decided to document another tool recommended by a colleague—the fuck command.
