text_combined: senseval 2nd call participants papers second call participation wsd evaluation exercise senseval workshop announcement senseval lexicography loop sponsored acl siglex euralex many automatic word sense disambiguation wsd programs currently hard determine better worse strengths weaknesses lie widespread agreement field urgently needs evaluation framework auspices acl siglex euralex pilot take place course 1998 arpa evaluation exercises framework comprises 1 definition task scoring metric 2 preparation set manually tagged correct answers 3 dry run sample data distributed participants 4 distribution test data participants participants sensetag return taggings scored correct answers 5 workshop discuss results lessons learned way forward shall undertaking evaluation least english french italian spanish workshop held herstmonceux castle sussex uk sept 2 4 1998 working wsd program one summer 1998 would like subject objective quantitative evaluation skills resources would like contribute exercise first look http www itri bton ac uk events senseval expinterest html mail expression interest sensevalcoord itri bton ac uk timetable soon possible expressions interest registered end april 98 ry run data samples distributed participants june 98 test data distributed participants one week later returned taggings july 98 correct answers scores made available sept 98 workshop workshop comprise 1 reports papers manual tagging aspects evaluation exercise 2 reports papers participants design performance system 3 related research papers 4 working sessions way ahead wsd evaluation deadline related research papers 16th april 1998 preference given papers discussing wsd particular attention evaluation issues maximum submission length 6 pages first page include title abstract author name contact details electronic submission postscript documents permitted must supported hard copy arrive later 23rd april case printing problems email sensevalsubmissions itri bton ac uk hard copy senseval submissions itri university brighton lewes road brighton bn2 4gj uk full details available http www itri bton ac uk events senseval adam kilgarriff senseval coordinator