On: State-of-the-art open-source chatbot, Vicuna-13B, ...

[MuffinFlavored]

> A large array of uniquely-set floating point values.

How large? How many elements?

[skrblr → MuffinFlavored]

It's in the name of the model - "Vicuna-13B" implies there are 13 billion parameters.

[MuffinFlavored → skrblr]

the way these LLMs work, there is a weight for each parameter? 13 billion weights? what is an example of a parameter?

[dragonwriter → MuffinFlavored]

A parameter is a variable for which a weight (a floating point value) is the concrete value.

[kragen → MuffinFlavored]

a weight is an example of a parameter

so is a bias, and presumably the biases are also in the same file with the weights