Although Linux is reputed to be less susceptible to viruses distributed by hackers, it still remains a highly valuable and economically efficient operating system, particularly as a stable server or development environment. Consequently, Linux is not immune to malware or hacker attacks, albeit less frequent than in Windows systems.
Read More »[Linux] Installation And Use Of Open Source Anti-virus Tool: ClamAV Swap space plays an important role in Linux operating systems. It can be understood as a virtual memory space, where its name implies the act of swapping. Swap allows for temporarily writing less frequently used data to a fixed hard disk space to ensure stable system operation when the physical memory (RAM) is insufficient — this space is Swap.
Read More »[Linux] Increase Swap Space Using Commands to Prevent Memory Exhaustion
yield is a keyword in Python, utilized much like return, the use of yield transforms a function into a Generator.
FastAPI is a modern, high-performance Python web framework. It is based on Python 3.7+ and utilizes Python type hints.
Read More »[Python] Notes on Backend Development Using the FastAPI Framework duf is a tool that offers a more "graphical representation" for checking disk space usage on Linux systems, with its name derived from Disk Usage/Free Utility. It's worth mentioning that this tool can also be installed not only on Linux but also on MacOS and Windows.
In the midst of exploring various AI models, perhaps owing to a habit cultivated during my time in research institutes, I find myself invariably sifting through research papers pertinent to the models, systems, or libraries I’m working on.
Read More »Consensus: Harnessing AI-Powered Engines for Streamlined Research Paper Searches Recently, I trace many codes about LLaMA LoRA training (almost two months ago...), and when I reading the codes, I found if they want to configure the prompt for LLMs, if they need to change the prompt content by different training, the format_map() function is the best choice.
When using the transformers package, often we receive the following error message when we utilize different task models with various heads like AutoModelForSequenceClassification, AutoModelForSeq2SeqLM...
Read More »[Solved] Some weights of the model checkpoint at distilbert-base-multilingual-cased were not used when initializing DistilBertForSequenceClassification: ['vocab_projector.bias', 'vocab_layer_norm.bias', 'vocab_layer_norm.weight', 'vocab_transform.weight', 'vocab_transform.bias']
Moderation endpoint is a free tool that developed by OpenAI. It is design for detecting "Not Mode-rational Content" or "Sensitive Content". The more detailed list you can refer https://openai.com/policies/usage-policies.
Read More »Using OpenAI Moderation Endpoint To Dectect Not Moderation Content
Today when I training the model on my server, I write an GPU parallel training script, and input the newest training data; but in the process of training, I got an error message about "GPU not found". After I using torch.cuda.is_available() to check my device, I got another error message as following:
