pingu_98/mpt-7B-inference
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

readme

Browse source
This commit is contained in:
Anton Bacaj 2023-06-26 07:12:21 +00:00
parent c6e2d7305b
commit a4eab07cc0
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -6,7 +6,7 @@ Run inference on the latest MPT-30B model using your CPU. This inference code us
## Requirements ## Requirements
I recommend you use docker for this model, it will make everything easier for you. I recommend a system with 32GB of ram. Tested on AMD Epyc CPU, Python 3.10. I recommend you use docker for this model, it will make everything easier for you. Minimum specs system with 32GB of ram otherwise limit the `context_length` of model. Tested on AMD Epyc CPU, Python 3.10.
## Setup ## Setup