Steelskull commited on
Commit
f31cd17
1 Parent(s): 88d3ae5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -102,6 +102,7 @@ tags:
102
  <p><strong>Unique Final Layers:</strong> 14 (25.5% of model)</p>
103
  <h2>Model Characteristics</h2>
104
  <ul>
 
105
  <li>Combines benefits of early and mid duplication strategies</li>
106
  <li>Balanced between unique initial layers, duplicated middle layers, and unique final layers</li>
107
  <li>Versatile approach suitable for a wide range of tasks</li>
 
102
  <p><strong>Unique Final Layers:</strong> 14 (25.5% of model)</p>
103
  <h2>Model Characteristics</h2>
104
  <ul>
105
+ <li>Models down_proj and o_proj layers have been nulled and will require healing</li>
106
  <li>Combines benefits of early and mid duplication strategies</li>
107
  <li>Balanced between unique initial layers, duplicated middle layers, and unique final layers</li>
108
  <li>Versatile approach suitable for a wide range of tasks</li>