From 5029906cc2d6ac79c918ead38ea0751cb91ed59a Mon Sep 17 00:00:00 2001 From: Anton Bacaj Date: Mon, 26 Jun 2023 15:53:28 +0000 Subject: [PATCH] update readme --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index 383959c..576a64b 100644 --- a/README.md +++ b/README.md @@ -2,6 +2,12 @@ Run inference on the latest MPT-30B model using your CPU. This inference code uses a [ggml](https://github.com/ggerganov/llama.cpp) quantized model. To run the model we'll use a library called [ctransformers](https://github.com/marella/ctransformers) that has bindings to ggml in python. +Turn style with history on latest commit: + +[Inference Chat](https://user-images.githubusercontent.com/7272343/248859199-28a82f3d-ee54-44e4-b22d-ca348ac667e3.png) + +Video of initial demo: + [Inference Demo](https://github.com/abacaj/mpt-30B-inference/assets/7272343/486fc9b1-8216-43cc-93c3-781677235502) ## Requirements