In recent years, the transparency of mainstream models in the field of artificial intelligence has become a focus. Stanford University, MIT, Princeton University and other institutions have jointly proposed the "Basic Model Transparency Index" to evaluate the transparency of the top ten mainstreamAI ModelsThe results show thatLlama2nd rankFirst, while models such as GPT-4 are less transparent.
Despite the growing social impact of AI models, there are still many questions about how these models are built, trained, and used, including data sources, labor treatment, etc. However, the evaluation system has also sparked some controversy, with some developers believing that it is too naive to require companies to disclose trade secrets.
Paper address: https://arxiv.org/pdf/2310.12941.pdf
Nevertheless, transparency is crucial to the development and application of AI models, especially in the field of generative AI, because models have the potential to improve productivity but may also be used to harm others. Lack of transparency may lead to the abuse of models, so developers need to pay more attention to transparency, including the disclosure of model construction, functions, risks, etc.
However, most major basic model developers currently fail to provide sufficient transparency, which highlights the urgent need for transparency improvement in the AI industry. At the same time, open source basic models such as Llama2 and BLOOMZ received high scores, but there is still room for improvement because only a very small number of developers transparently display the limitations of the model and other key information.
In the current policy debate, whether AI models should be open source has become a controversial focus, but whether open source or closed source, transparency is a key factor to ensure that the negative impact of AI models is controlled.