text_combined: evaluation parsing systems evaluation parsing systems workshop jointly organised cec language engineering 1 projects sparkle ecran held first international conference language resources evaluation granada spain 26 may 1998 workshop provide forum researchers interested development evaluation natural language grammars parsing systems creation syntactically annotated reference corpora organisers john carroll roberto basili nicoletta calzolari robert gaizauskas gregory grefenstette workshop scope aims aim workshop provide forum discussion evaluation methods parsing systems proposals development syntactically annotated language resources increased attention evaluation component technology language engineering evaluation parsing systems rapidly becoming key issue numerous methods proposed one parseval penn treebank scheme gained wide usage extent due absence workable alternatives rather wholehearted support parseval ptb evaluation several limitations drawbacks including commitment particular style grammatical analysis oversensitivity certain innocuous types misanalysis failing penalise common types serious mistake also original published description scheme evaluation software widely distributed followup specific english language may currently alternative workable schemes proposals needs fully discussed workshop provide opportunity debate workshop particularly timely given large number cec language engineering projects involve parsing one form another need evaluate share results efforts parsing essential part many larger applications information extraction gained importance last years often systems strength parser grammar direct effect desired results thus achieving good results rests able determine improve weaknesses parser grammar without reliable parser evaluation method done effectively parsing evaluation workshop also appropriate time given imminent creation largescale syntactically annotated resources european languages contributions involved activities welcomed improve communication resource construction resource utilisation communities ensure resources constructed maximally useful general language engineering community organisation workshop brings together two european language engineering projects closely related whose partners share similar research interests sparkle ecran organisers solicit contributions general community following topics descriptions generic syntactic annotation schemes methodologies metrics parsing system evaluation reports analyses results utilising particular parser evaluation schemes description analysis experience languagedependent especially languages english taskdependent syntactic annotation schemes programme committee roberto basili gregory grefenstette ted briscoe mark hepple nicoletta calzolari tony mcenery john carroll maria teresa pazienza roberta catizone paola velardi robert gaizauskas yorick wilks paper submission papers exceed 4000 words 10 pages submission may either hard copy electronic form submission deadline february 15th 1998 hard copy submission three copies paper sent dr john carroll cognitive computing sciences university sussex brighton bn1 9qh uk electronic submission electronic submission may either selfcontained latex postscript rtf formats john carroll cogs susx ac uk submission whether hard copy electronic separate plain ascii text email message sent john carroll containing following information name name first author title title paper pages number pages note relevant instructions keys keywords email email first author abstr abstract paper important dates paper submission deadline hard copy electronic february 15th notification acceptance march 10th camera ready papers due april 10th workshop may 26th conference information general information conference http www icp inpg fr elra conflre html see http ceres ugr es rubio elra html information local arrangements specific queries conference directed lrec secretariat facultad de traduccion e interpretacion dpto de traduccion e interpretacion c puentezuelas 55 18002 granada spain tel 34 58 24 41 00 fax 34 58 24 41 04 reli98 goliat ugr es