ammoman21 commited on
Commit
7660bd0
·
verified ·
1 Parent(s): 70a3bcd

Fix .eval_results/parsebench.yaml: standard HF eval-result array schema

Browse files
Files changed (1) hide show
  1. .eval_results/parsebench.yaml +60 -15
.eval_results/parsebench.yaml CHANGED
@@ -1,15 +1,60 @@
1
- # .eval_results/parsebench.yaml — for the HF model repo per ParseBench submission docs
2
- benchmark: parsebench
3
- model: florin-inc/florin-parser-nano
4
- results:
5
- overall: 76.92 # mean of two full runs (76.95, 76.89)
6
- tables: 86.10
7
- charts: 65.33
8
- content_faithfulness: 87.34
9
- semantic_formatting: 71.69
10
- visual_grounding: 74.15
11
- notes: >
12
- LoRA fine-tune of KDLAI/KDL-Frontier-Parser-nano with emission patches; full-corpus
13
- run, all dimensions measured; chart LLM normaliser off; reproduction repo linked in
14
- model card. Two independent full runs: 76.95, 76.89 (delta 0.06).
15
- community_provided: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: llamaindex/ParseBench
3
+ task_id: mean
4
+ value: 76.92
5
+ date: '2026-08-18'
6
+ source:
7
+ url: https://huggingface.co/datasets/llamaindex/ParseBench
8
+ name: ParseBench
9
+ user: florin-inc
10
+ notes: "Pipeline name: florin_parser_nano (provider subclass, run-llama/ParseBench PR #99). Mean of two independent full-corpus runs (76.95, 76.89, delta 0.06), all 2,079 files, five dimensions. LoRA fine-tune of KDLAI/KDL-Frontier-Parser-nano (language layers only) plus markdown-emission patches; production prompt unchanged. Chart LLM normaliser off (LLAMACLOUD_BENCH_LLM_NORMALIZATION=off). Same-environment baseline reproduction of kdl_frontier_nano: 72.65. Reproduction repo: https://github.com/ammoman21/parsebench-open-weight-sota"
11
+ - dataset:
12
+ id: llamaindex/ParseBench
13
+ task_id: table
14
+ value: 86.10
15
+ date: '2026-08-18'
16
+ source:
17
+ url: https://huggingface.co/datasets/llamaindex/ParseBench
18
+ name: ParseBench
19
+ user: florin-inc
20
+ notes: "Pipeline name: florin_parser_nano (run-llama/ParseBench PR #99)"
21
+ - dataset:
22
+ id: llamaindex/ParseBench
23
+ task_id: chart
24
+ value: 65.33
25
+ date: '2026-08-18'
26
+ source:
27
+ url: https://huggingface.co/datasets/llamaindex/ParseBench
28
+ name: ParseBench
29
+ user: florin-inc
30
+ notes: "Pipeline name: florin_parser_nano (run-llama/ParseBench PR #99)"
31
+ - dataset:
32
+ id: llamaindex/ParseBench
33
+ task_id: text_content
34
+ value: 87.34
35
+ date: '2026-08-18'
36
+ source:
37
+ url: https://huggingface.co/datasets/llamaindex/ParseBench
38
+ name: ParseBench
39
+ user: florin-inc
40
+ notes: "Pipeline name: florin_parser_nano (run-llama/ParseBench PR #99)"
41
+ - dataset:
42
+ id: llamaindex/ParseBench
43
+ task_id: text_formatting
44
+ value: 71.69
45
+ date: '2026-08-18'
46
+ source:
47
+ url: https://huggingface.co/datasets/llamaindex/ParseBench
48
+ name: ParseBench
49
+ user: florin-inc
50
+ notes: "Pipeline name: florin_parser_nano (run-llama/ParseBench PR #99)"
51
+ - dataset:
52
+ id: llamaindex/ParseBench
53
+ task_id: layout
54
+ value: 74.15
55
+ date: '2026-08-18'
56
+ source:
57
+ url: https://huggingface.co/datasets/llamaindex/ParseBench
58
+ name: ParseBench
59
+ user: florin-inc
60
+ notes: "Pipeline name: florin_parser_nano (run-llama/ParseBench PR #99)"