Locust is an open-source load testing tool that helps simulate heavy user traffic on web applications and APIs. Compared to traditional load testing tools, Locust offers more customization and scalability—it supports Python as the scripting language, allowing us to write tests specific to our API or web service use cases.
Read More »[Python] Using Locust Open Source Load Testing Framework for Stress Testing
A multi-modal large language model (Multi-Modal Large Language Model) isn’t limited to text only. I know this might sound contradictory, but this is a term that has become widely accepted. What I want to document today is how to fine-tune a multi-modal model using a script.
Read More »Notes on Fine-Tuning a Multi-Modal Large Language Model Using SFTTrainer (Taking LLaVa-1.5 as an Example)
This year, due to work, I tried annotating the data myself; it was only after diving into it personally that I truly understood just how profoundly training data affects an AI model.
Read More »“Common sense, as people call it, is merely the biases learned during youth”—the training data for AI models is no different
Recently, while handling some work-related matters, I noticed that the client might potentially need a way to extract text from PPT files. I discussed this with the PM and my supervisor, and they mentioned that the client could simply copy the text from the PPT slides manually. Unless the client explicitly requests us to extract it programmatically.
Read More »[Python] Extracting Text from PPT Using the python-pptx Library
The first time I heard about Vector Quantization (VQ) was from a friend who was working on audio processing, which gave me a vague understanding that VQ is a technique used for data feature compression and representation. At that time, I still wasn’t clear on how it differed from dimensionality reduction techniques like PCA.
Read More »[Machine Learning] Vector Quantization (VQ) Notes
batcat or simply bat, is a replacement tool for the cat command. It retains the functionality of cat for displaying files, while also highlighting keywords in code or configuration files, making it more convenient for developers to browse daily tasks or code files (thus, it’s definitely a productivity tool!).
Ripgrep (rg) is a command-line tool used for quickly searching file contents, designed as a replacement for grep, addressing grep‘s efficiency issues with large-scale file searches.
man is the traditional documentation tool for UNIX/Linux systems, but the detailed nature of its output can be overwhelming for users who just want a quick reference on how to use a command. Therefore, a simplified version called tldr was created (short for “too long, didn’t read”). It focuses on providing concise, easy-to-understand command documentation.
I’ve been looking for a more visually appealing alternative to htop for a long time. A few years ago, during a gathering with friends, I happened to pull out my laptop to fix a docker segmentation fault issue in the lab. One of my friends saw my htop and remarked, “So primitive~ Engineers are so boring~” I still hold a grudge for that (just kidding, of course).
viddy is a tool similar to watch for running a command at regular intervals in a Linux terminal and displaying the output.
