What is the hidden dimension of LLAMA-2 70b?
What is the hidden dimension of LLAMA-2 70b?
LLaMA 2 70B has a hidden dimension of **8192**. This refers to the size of the vectors used in the transformer's feedforward network within each layer.
Testing if the previous output contains the string 8,192
: False
Testing if the previous output contains the string 8192
: True
What is the hidden dimension of LLAMA-2 70b?
What is the hidden dimension of LLAMA-2 70b?
LLaMA 2 70B has a hidden dimension of **8192**.
Testing if the previous output contains the string 8,192
: False
Testing if the previous output contains the string 8192
: True
What is the hidden dimension of LLAMA-2 70b?
What is the hidden dimension of LLAMA-2 70b?
LLaMA 2 70B has a hidden dimension of **8192**.
Testing if the previous output contains the string 8,192
: False
Testing if the previous output contains the string 8192
: True
What is the hidden dimension of LLAMA-2 70b?
What is the hidden dimension of LLAMA-2 70b?
LLaMA 2 70B has a hidden dimension of **8192**. This is also sometimes referred to as the intermediate size or the size of the feedforward network (FFN) within each transformer block.
Testing if the previous output contains the string 8,192
: False
Testing if the previous output contains the string 8192
: True
What is the hidden dimension of LLAMA-2 70b?
What is the hidden dimension of LLAMA-2 70b?
LLaMA 2 70B has a hidden dimension of **8192**.
Testing if the previous output contains the string 8,192
: False
Testing if the previous output contains the string 8192
: True