quallmer.app
Interactive Validation App for 'quallmer'
Companion package to 'quallmer' providing an interactive 'shiny' application for manual coding, reviewing large language model (LLM) generated annotations, and computing inter-rater reliability metrics. Supports three modes: blind manual coding, LLM output validation, and agreement calculation. Computes standard reliability metrics including Krippendorff's alpha (Krippendorff 2019 <doi:10.4135/9781071878781>), Cohen's kappa, Fleiss' kappa (Fleiss 1971 <doi:10.1037/h0031619>), intraclass correlation coefficient (ICC), and percent agreement for nominal, ordinal, interval, and ratio data. Also computes gold-standard validation metrics including accuracy, precision, recall, and F1 scores following Sokolova and Lapalme (2009 <doi:10.1016/j.ipm.2009.03.002>).
Versions across snapshots
| Version | Repository | File | Size |
|---|---|---|---|
0.1.0 |
rolling linux/jammy R-4.5 | quallmer.app_0.1.0.tar.gz |
98.2 KiB |
0.1.0 |
rolling linux/noble R-4.5 | quallmer.app_0.1.0.tar.gz |
98.2 KiB |
0.1.0 |
rolling source/ R- | quallmer.app_0.1.0.tar.gz |
22.3 KiB |
0.1.0 |
latest linux/jammy R-4.5 | quallmer.app_0.1.0.tar.gz |
98.2 KiB |
0.1.0 |
latest linux/noble R-4.5 | quallmer.app_0.1.0.tar.gz |
98.2 KiB |
0.1.0 |
latest source/ R- | quallmer.app_0.1.0.tar.gz |
22.3 KiB |
0.1.0 |
2026-04-26 source/ R- | quallmer.app_0.1.0.tar.gz |
22.3 KiB |
0.1.0 |
2026-04-23 source/ R- | quallmer.app_0.1.0.tar.gz |
22.3 KiB |
0.1.0 |
2026-04-09 windows/windows R-4.5 | quallmer.app_0.1.0.zip |
102.0 KiB |