text_combined: evaluation parsing systems call participation evaluation parsing systems granada spain 26 may 1998 workshop part first international conference language resources evaluation university granada may 26th 30th 1998 see http ceres ugr es rubio elra html details register workshop provide forum researchers interested development evaluation natural language grammars parsing systems creation syntactically annotated reference corpora organisers john carroll roberto basili nicoletta calzolari robert gaizauskas gregory grefenstette accepted papers survey parser evaluation methods john carroll ted briscoe university sussex university cambridge uk evaluating robust parser italian language roberto basili maria teresa pazienza fabio massimo zanzotto universita di roma tor vergata rome italy evaluation syntactic analysis component information extraction system german thierry declerck judith klein guenter neumann dfki saarbruecken germany chunking italian linguistic taskoriented evaluation stefano federici simonetta montemagni vito pirrelli ilccnr pisa italy modifying existing annotated corpora general comparative evaluation parsing rob gaizauskas mark hepple chris huyck university sheffield uk dependency based evaluation minipar dekang lin university manitoba canada evaluating parses spoken language dialogue systems wolfgang minker lin chase limsi france corpus based parse pruning sonja mueller landmann ibm heidelberg germany tosca parsing system reviewed nelleke oostdijk katholieke universiteit nijmegen netherlands grammar parser evaluation xtag project srinivas bangalore anoop sarkar christine doran beth ann hockey att labs research ircs university pennsylvania usa workshop scope aims aim workshop provide forum discussion evaluation methods parsing systems proposals development syntactically annotated language resources increased attention evaluation component technology language engineering evaluation parsing systems rapidly becoming key issue numerous methods proposed one parseval penn treebank scheme gained wide usage extent due absence workable alternatives rather wholehearted support parseval ptb evaluation several limitations drawbacks including commitment particular style grammatical analysis oversensitivity certain innocuous types misanalysis failing penalise common types serious mistake also original published description scheme evaluation software widely distributed followup specific english language may currently alternative workable schemes proposals needs fully discussed workshop provide opportunity debate workshop particularly timely given large number cec language engineering projects involve parsing one form another need evaluate share results efforts parsing essential part many larger applications information extraction gained importance last years often systems strength parser grammar direct effect desired results thus achieving good results rests able determine improve weaknesses parser grammar without reliable parser evaluation method done effectively parsing evaluation workshop also appropriate time given imminent creation largescale syntactically annotated resources european languages contributions involved activities welcomed improve communication resource construction resource utilisation communities ensure resources constructed maximally useful general language engineering community workshop jointly organised cec language engineering 1 projects sparkle ecran programme committee roberto basili gregory grefenstette ted briscoe mark hepple nicoletta calzolari tony mcenery john carroll maria teresa pazienza roberta catizone paola velardi robert gaizauskas yorick wilks