Small Model

Nowadays, small language models are becoming more popular, and many manufacturers have begun to launch "small models" suitable for lightweight devices such as mobile phones. This week, Hugging Face announced the "SmolLM" small language model family, which includes 135 million, 360 million and 1.7 billion parameter models. According to reports, these models are said to be trained with carefully planned high-quality training data sets and are said to be quite powerful in Python programming performance. The team pointed out that they focused on optimizing the amount of RAM required by the model, "even on an iPhone with 6GB RAM...