Files
ruvnet--RuView/benchmarks/wiflow-std/results/repro_a.json
T
ruv e1936c9a24 feat(benchmarks): WiFlow-STD reproduction harness + measurement (a) results (ADR-152 §2.2)
Shipped checkpoint REFUTED (0.08% PCK@20, wrong keypoint normalization);
6 reproducibility defects documented (broken imports, corrupted dataset
tail with float32-max garbage that NaN-poisons fp16 BatchNorm, unreachable
test phase). After repairs, retraining with upstream defaults reproduces
96.09% PCK@20 full-test / 96.61% corruption-free (published 97.25%) on
RTX 5080. Claims graded MEASURED-EQUIVALENT; 2.23M params + ~0.055 GFLOPs
verified. Third-party code/weights/data stay out of tree (gitignored).

Co-Authored-By: claude-flow <ruv@ruv.net>
2026-06-10 18:54:03 -04:00

32 lines
873 B
JSON

{
"published": {
"pck@20": 0.9725,
"pck@30": 0.9863,
"pck@40": 0.9916,
"pck@50": 0.9948,
"mpjpe": 0.007
},
"params_millions": 2.225042,
"data_dir": "C:\\Users\\ruv\\.cache\\kagglehub\\datasets\\kaka2434\\wiflow-dataset\\versions\\1\\preprocessed_csi_data",
"device": "cpu",
"test_full": {
"samples": 54000,
"mpjpe": NaN,
"pck@10": 5.6790124349020145e-05,
"pck@20": 0.0007876543271596785,
"pck@30": 0.007780246982971827,
"pck@40": 0.05529259262923841,
"pck@50": 0.1542370371548114,
"wall_seconds": 118.03756999969482
},
"test_drop_last": {
"samples": 53952,
"mpjpe": NaN,
"pck@10": 5.6840649370682976e-05,
"pck@20": 0.0007883550872372227,
"pck@30": 0.007787168910892621,
"pck@40": 0.055318307667895535,
"pck@50": 0.15425316342412276,
"wall_seconds": 120.87458372116089
}
}