rss
J Am Med Inform Assoc 16:585-589 doi:10.1197/jamia.M3091
  • Focus on i2b2 Obesity NLP Challenge

Natural Language Processing Framework to Assess Clinical Conditions

Table 3

Kappa Metric Overall for the Test Set

Test All Textual
Y N Q U
Y 2098 9 5 94
N 10 34 0 22
Q 6 0 8 1
U 78 22 4 5653
K1 NA
K2 92.4
Test All Intuitive
Y N Q U
Y 2131 102 5 22
N 10148 4998 9 0
Q 6 0 0 0
U 0 0 0 0
K1 NA
K2 91.4

  • X-Axis: Gold Scoring; Y-Axis: Program Scoring.

  • K1: Annotator Kappa agreement overall – not available.

  • K2: Overall results for program versus gold Kappa on the Test set.

This Article

  1. Abstract
  2. Full text
  3. PDF
  4. Data Supplement

Access policy for JAMIA

All content published in JAMIA is deposited with PubMed Central by the publisher with a 12 month embargo. Authors/funders may pay an Unlocked fee of $2,000 to make the article free on the JAMIA website and PMC immediately on publication.

All content older than 12 months is freely available on this website.

AMIA members can log in with their JAMIA user name (email address) and password or via the AMIA website.