[Python] yield and Generator
Introduction
yield
is a keyword in Python, utilized much like return
, the use of yield
transforms a function into a Generator.
yield
is a keyword in Python, utilized much like return
, the use of yield
transforms a function into a Generator.
FastAPI is a modern, high-performance Python web framework. It is based on Python 3.7+ and utilizes Python type hints.
Read More »[Python] Notes on Backend Development Using the FastAPI Frameworkduf
is a tool that offers a more “graphical representation” for checking disk space usage on Linux systems, with its name derived from Disk Usage/Free Utility. It’s worth mentioning that this tool can also be installed not only on Linux but also on MacOS and Windows.
In the midst of exploring various AI models, perhaps owing to a habit cultivated during my time in research institutes, I find myself invariably sifting through research papers pertinent to the models, systems, or libraries I’m working on.
Read More »Consensus: Harnessing AI-Powered Engines for Streamlined Research Paper SearchesRecently, I trace many codes about LLaMA LoRA training (almost two months ago…), and when I reading the codes, I found if they want to configure the prompt for LLMs, if they need to change the prompt content by different training, the format_map()
function is the best choice.
When using the transformers package, often we receive the following error message when we utilize different task models with various heads like AutoModelForSequenceClassification, AutoModelForSeq2SeqLM…
Read More »[Solved] Some weights of the model checkpoint at distilbert-base-multilingual-cased were not used when initializing DistilBertForSequenceClassification: [‘vocab_projector.bias’, ‘vocab_layer_norm.bias’, ‘vocab_layer_norm.weight’, ‘vocab_transform.weight’, ‘vocab_transform.bias’]Moderation endpoint is a free tool that developed by OpenAI. It is design for detecting “Not Mode-rational Content” or “Sensitive Content“. The more detailed list you can refer https://openai.com/policies/usage-policies.
Read More »Using OpenAI Moderation Endpoint To Dectect Not Moderation ContentToday when I training the model on my server, I write an GPU parallel training script, and input the newest training data; but in the process of training, I got an error message about “GPU not found“. After I using torch.cuda.is_available()
to check my device, I got another error message as following:
Meta AI has indeed been incredibly powerful recently, seemingly securing its position as a giant in AI research and development in no time at all, and what’s more, it sets the bar high with all its top-tier open-source contributions. From Segment Anything that can segment objects in the image domain, to the public large language model and foundational model, LLaMA (yes, the one causing the llama family appear!), to the recent ImageBind that can transform six modalities and the Massively Multilingual Speech (MMS) project… I must say, for an ordinary person like me, it’s quite an effort to keep up with how to use these technologies, let alone trying to chase their technical prowess.
Read More »ImageBind: A Experience Notes on a Multimodal Vector Transformation ModelFirst, let’s introduce BigCode! BigCode is an open science collaboration project co-led by Hugging Face and ServiceNow, with the goal of jointly code large language models (LLMs) that can be applied to “programming.”
Read More »BigCode & StarCoder: Large Language Model Projects Specialized in Programming