2. Memory Requirements
Runs on most modern computers. Unless your computer is very very old, it
should work.
According to a llama.cpp discussion thread, here are the memory
requirements:
� 7B => ~4 GB
� 13B => ~8 GB
� 30B => ~16 GB
� 65B => ~32 GB
3. Disk Space Requirements
Alpaca
Currently 7B and 13B models are available via alpaca.cpp
7B
Alpaca comes fully quantized (compressed), and the only space you need for
the 7B model is 4.21GB:
You do NOT have to install all models, you can install one by one. Let's take a
look at how much space each model takes up:
NOTE
The following numbers assume that you DO NOT touch the original model
files and keep BOTH the original model files AND the quantized versions.
You can optimize this if you delete the original models (which are much
larger) after installation and keep only the quantized versions.
7B
� Full: The model takes up 31.17GB
� Quantized: 4.21GB
13B
� Full: The model takes up 60.21GB
� Quantized: 4.07GB * 2 = 8.14GB
