Testing my anaphora resolution tool -
i in course of building anaphora resolution tool. have done lot of literature review , have pretty idea on should build basic tool. however, problem is, how test it. can't find annotated corpus test on. suggest how measure precision , recall of tool.
from here: http://www.mitpressjournals.org/doi/pdf/10.1162/coli_a_00152
section 4.1
ontonotes-dev
– development partition of ontonotes v4.0 provided in conll2011 shared task (pradhan et al. 2011). ontonotes-test
– test partition of ontonotes v4.0 provided in conll-2011 shared task.
ace2004-culotta-test – partition of ace 2004 corpus reserved testing several previous studies (culotta et al. 2007; bengtson , roth 2008; haghighi , klein 2009).
ace2004-nwire – newswire subset of ace 2004 corpus, utilized poon , domingos (2008) , haghighi , klein (2009) testing.
muc6-test – test corpus sixth message understanding conference (muc-6) evaluation.
you can find muc details here http://www-nlpir.nist.gov/related_projects/muc/muc_data/muc_data_index.html
just around @ start of experimental section in references. bound find links. if @ commonly used ones, find data sets.
Comments
Post a Comment