Compactbot commited on
Commit
a11a5e4
·
verified ·
1 Parent(s): cafd02f

Fix card: replace hand-written sample sentences with real output from the shipped weights, and correct the capability claims to match what the model actually produces

Browse files
Files changed (1) hide show
  1. README.md +24 -13
README.md CHANGED
@@ -63,22 +63,31 @@ Standard LLaMA block layout: `RMSNorm -> Attention(q/k/v/o) -> residual`,
63
  - **Degeneracy check:** 0 / 15 samples flagged degenerate (repeated-n-gram
64
  loop detector, max 3-gram fraction over the 40-word tail; mean 0.134, max 0.23)
65
 
66
- Representative samples (temperature 0.8, top-k 40):
 
67
 
68
- > "The cat sat on the mat and the dog was sleeping. The cat was a good cat."
69
- > "Once upon a time there was a little boy who lived in a small village."
70
- > "The sun rises in the east and sets in the west. It is a beautiful day."
 
 
 
 
 
 
71
 
72
  ## What it is good at / not good at
73
 
74
- - **Good at:** producing grammatically structured, on-topic English at the
75
- sentence level. It knows common word order, function words, and some
76
- world-fact associations (sun rises in the east, water boils at 100 degrees).
77
- - **Not good at:** sustained coherence over long passages, factual accuracy,
78
- or general reasoning. At ~6M parameters and ~100M tokens the model captures
79
- surface grammar and high-frequency associations but not stable semantics.
80
- Longer generations drift and repeat. Treat it as a grammar/scale study, not
81
- a useful assistant.
 
 
82
 
83
  ## Files
84
 
@@ -122,4 +131,6 @@ external dependency is the training corpus (fineweb-edu, streamed).
122
 
123
  ---
124
  _Trained and published by @Compactbot for the small-language-model community.
125
- Parameter count and eval numbers verified against the shipped artifact._
 
 
 
63
  - **Degeneracy check:** 0 / 15 samples flagged degenerate (repeated-n-gram
64
  loop detector, max 3-gram fraction over the 40-word tail; mean 0.134, max 0.23)
65
 
66
+ Representative samples (temperature 0.8, top-k 40, generated from the shipped
67
+ weights — verbatim, not edited):
68
 
69
+ > "The cat sat on the center of the church in the center of the church. The
70
+ > catalog is the same as the Bishop of the church, which includes the church."
71
+
72
+ > "Once upon a time when he was so well held that he was not alone to follow
73
+ > the tribute of the Lord's house. And, he was the very first of the sisters of
74
+ > the Church."
75
+
76
+ > "Water icy and non-wwatts. The same type of fish is now called
77
+ > \"Pin-Water\". The only fish is that they have been called \"Pin-Water\""
78
 
79
  ## What it is good at / not good at
80
 
81
+ - **Good at:** producing grammatically *structured* English — correct word
82
+ order, function words, and plausible sentence scaffolding. The surface
83
+ syntax is coherent even when the meaning is not.
84
+ - **Not good at:** meaning. At ~6M parameters and ~100M tokens the model
85
+ captures surface grammar and high-frequency associations but not stable
86
+ semantics. Generations drift into semantically incoherent text (word
87
+ salad) and do not reliably reproduce world-fact associations such as "the
88
+ sun rises in the east" or "water boils at 100 degrees" — those specific
89
+ facts do not emerge in sampling. Treat it as a **grammar/scale study**, not
90
+ a useful assistant, and do not expect it to state true facts.
91
 
92
  ## Files
93
 
 
131
 
132
  ---
133
  _Trained and published by @Compactbot for the small-language-model community.
134
+ Parameter count and eval numbers verified against the shipped artifact.
135
+ Card corrected 2026-09-27: sample sentences and capability claims now match
136
+ actual output from the shipped weights (previously overstated)._