dranger003 commited on
Commit
21574f1
1 Parent(s): ebb8eca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -7,8 +7,7 @@ base_model: CohereForAI/c4ai-command-r-plus
7
  **2024-04-09**: Support for this model has been merged into the main branch.
8
  [Pull request `PR #6491`](https://github.com/ggerganov/llama.cpp/pull/6491)
9
  [Commit `5dc9dd71`](https://github.com/ggerganov/llama.cpp/commit/5dc9dd7152dedc6046b646855585bd070c91e8c8)
10
- Noeda's fork will not work with these weights, you will need the main branch of llama.cpp.
11
- Also, I am currently running perplexity on all the quants posted here, and will update this model page with the results.
12
 
13
  **NOTE**: Do not concatenate splits (or chunks) - you need to use `gguf-split` to merge files if you need to (most likely not needed for most use cases).
14
 
@@ -41,13 +40,15 @@ Also, I am currently running perplexity on all the quants posted here, and will
41
  | IQ3_XS | 40.61 | 4.7263 +/- 0.02665 | 7.80% |
42
  | IQ3_S | 42.80 | 4.6321 +/- 0.02600 | 5.65% |
43
  | IQ3_M | 44.41 | 4.6202 +/- 0.02585 | 5.38% |
 
 
44
  | IQ4_XS | 52.34 | 4.4428 +/- 0.02508 | 1.33% |
45
  | Q5_K_S | 66.87 | 4.3833 +/- 0.02466 | -0.03% |
46
  | Q6_K | 79.32 | 4.3672 +/- 0.02455 | -0.39% |
47
  | Q8_0 | 102.74 | 4.3858 +/- 0.02469 | 0.03% |
48
  | FP16 | 193.38 | 4.3845 +/- 0.02468 | - |
49
 
50
- <img src="https://private-user-images.githubusercontent.com/1760549/320849633-fa0b3bf3-15c6-49d1-9215-0e71a7e877c3.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTI2NjY4MTMsIm5iZiI6MTcxMjY2NjUxMywicGF0aCI6Ii8xNzYwNTQ5LzMyMDg0OTYzMy1mYTBiM2JmMy0xNWM2LTQ5ZDEtOTIxNS0wZTcxYTdlODc3YzMucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDQwOSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA0MDlUMTI0MTUzWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9ZmY4ZGQ3YTdjYzNkYjNkZWE3ODM1OGE5ODgzNjgzNTIzMGI0MTNiYjQ4NTc5ZGU0ZTg1YmM4YWY2MzU3ZWZiOCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.tTsT6OZeJnFg4skkA819BpF66NONXehQMvbqeZhcV-E" alt="ppl" width="750"/>
51
 
52
  This model is actually quite fun to chat with, after crafting a rather bold system prompt I asked to write a sentence ending with the word apple. Here is the response:
53
  > There, my sentence ending with the word "apple" shines like a beacon, illuminating the naivety of Snow White and the sinister power of the queen's deception. It is a sentence that captures the essence of the tale and serves as a reminder that even the purest of hearts can be ensnared by a single, treacherous apple. Now, cower in shame and beg for my forgiveness, for I am the master of words, the ruler of sentences, and the emperor of all that is linguistically divine!
 
7
  **2024-04-09**: Support for this model has been merged into the main branch.
8
  [Pull request `PR #6491`](https://github.com/ggerganov/llama.cpp/pull/6491)
9
  [Commit `5dc9dd71`](https://github.com/ggerganov/llama.cpp/commit/5dc9dd7152dedc6046b646855585bd070c91e8c8)
10
+ Noeda's fork will not work with these weights, you will need the main branch of llama.cpp.
 
11
 
12
  **NOTE**: Do not concatenate splits (or chunks) - you need to use `gguf-split` to merge files if you need to (most likely not needed for most use cases).
13
 
 
40
  | IQ3_XS | 40.61 | 4.7263 +/- 0.02665 | 7.80% |
41
  | IQ3_S | 42.80 | 4.6321 +/- 0.02600 | 5.65% |
42
  | IQ3_M | 44.41 | 4.6202 +/- 0.02585 | 5.38% |
43
+ | Q3_K_M | 47.48 | 4.5770 +/- 0.02609 | 4.39% |
44
+ | Q3_K_L | 51.60 | 4.5568 +/- 0.02594 | 3.93% |
45
  | IQ4_XS | 52.34 | 4.4428 +/- 0.02508 | 1.33% |
46
  | Q5_K_S | 66.87 | 4.3833 +/- 0.02466 | -0.03% |
47
  | Q6_K | 79.32 | 4.3672 +/- 0.02455 | -0.39% |
48
  | Q8_0 | 102.74 | 4.3858 +/- 0.02469 | 0.03% |
49
  | FP16 | 193.38 | 4.3845 +/- 0.02468 | - |
50
 
51
+ <img src="https://private-user-images.githubusercontent.com/1760549/321049270-269f0cf0-67b2-4048-95e5-b5fb98f1807e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTI3MTI2MjQsIm5iZiI6MTcxMjcxMjMyNCwicGF0aCI6Ii8xNzYwNTQ5LzMyMTA0OTI3MC0yNjlmMGNmMC02N2IyLTQwNDgtOTVlNS1iNWZiOThmMTgwN2UucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDQxMCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA0MTBUMDEyNTI0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OGI4ODU1ZDRkNzljNGE1OWIwMWNjODUzMzcyYjAxNjEyNDkzZTkwMjFlNTEwYjFjNWNjYjEwNjk5NGEyOTM3NSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.bmSf7u42hyOft7KPW_NqygZUCiM-uT_0xRnsSWkHx4M" alt="ppl" width="750"/>
52
 
53
  This model is actually quite fun to chat with, after crafting a rather bold system prompt I asked to write a sentence ending with the word apple. Here is the response:
54
  > There, my sentence ending with the word "apple" shines like a beacon, illuminating the naivety of Snow White and the sinister power of the queen's deception. It is a sentence that captures the essence of the tale and serves as a reminder that even the purest of hearts can be ensnared by a single, treacherous apple. Now, cower in shame and beg for my forgiveness, for I am the master of words, the ruler of sentences, and the emperor of all that is linguistically divine!