Initial Query

What is the hidden dimension of LLAMA-2 70b?

LLM Generation

Query

What is the hidden dimension of LLAMA-2 70b?

Output

LLaMA 2 70B has a hidden dimension of **8192**. This refers to the size of the vectors used in the transformer's feedforward network within each layer.

Check if any of the following conditions are true:

Substring Evaluation

Testing if the previous output contains the string 8,192: False

Substring Evaluation

Testing if the previous output contains the string 8192: True

Final Answer: True

Initial Query

What is the hidden dimension of LLAMA-2 70b?

LLM Generation

Query

What is the hidden dimension of LLAMA-2 70b?

Output

LLaMA 2 70B has a hidden dimension of **8192**.

Check if any of the following conditions are true:

Substring Evaluation

Testing if the previous output contains the string 8,192: False

Substring Evaluation

Testing if the previous output contains the string 8192: True

Final Answer: True

Initial Query

What is the hidden dimension of LLAMA-2 70b?

LLM Generation

Query

What is the hidden dimension of LLAMA-2 70b?

Output

LLaMA 2 70B has a hidden dimension of **8192**.

Check if any of the following conditions are true:

Substring Evaluation

Testing if the previous output contains the string 8,192: False

Substring Evaluation

Testing if the previous output contains the string 8192: True

Final Answer: True

Initial Query

What is the hidden dimension of LLAMA-2 70b?

LLM Generation

Query

What is the hidden dimension of LLAMA-2 70b?

Output

LLaMA 2 70B has a hidden dimension of **8192**. This is also sometimes referred to as the intermediate size or the size of the feedforward network (FFN) within each transformer block.

Check if any of the following conditions are true:

Substring Evaluation

Testing if the previous output contains the string 8,192: False

Substring Evaluation

Testing if the previous output contains the string 8192: True

Final Answer: True

Initial Query

What is the hidden dimension of LLAMA-2 70b?

LLM Generation

Query

What is the hidden dimension of LLAMA-2 70b?

Output

LLaMA 2 70B has a hidden dimension of **8192**.

Check if any of the following conditions are true:

Substring Evaluation

Testing if the previous output contains the string 8,192: False

Substring Evaluation

Testing if the previous output contains the string 8192: True

Final Answer: True