text_combined: gal kaminka zltzcsbiuacil apologies receive multiple copies message dear colleague happy announce call submissions aaai 2007 workshop evaluating architectures intelligence httpwwwcsbiuacilgalkarchitectures submission date april 15 2007 details please distribute interested parties appropriate purpose scope cognitive architectures form integral part robots agents architectures structure organize knowledge algorithms used agents select actions dynamic environments plan solve problems learn coordinate others architectures enable intelligent behavior agents serve integrate general capabilities expected intelligent agent eg planning learning implement test theories natural synthetic agent cognition explore domainindependent mechanisms intelligence ai research improved formal empirical rigor traditional evaluation methodologies architectures sometimes proved insufficient formal side rigorous analysis often proved elusive seem missing notation required formally proving properties architectures empirical side experiments demonstrate generality notoriously expensive perform sufficiently informative highlevel evaluation difficult criteria well defined generality ease programmability compatibility data biology psychology applicability real systems recognizing scientific progress depends ability conduct informative evaluation experiment formal analysis workshop address methodologies needed evaluating architectures focus evaluation methodology rather specific architectures many researchers investigating architectures surprisingly little published work evaluation methodology thus workshops immediate goal generate discussion wide spectrum evaluation challenges methods addressing next step harness discussions propose guidelines evaluation architectures would acceptable ai community allow researchers evaluate work progress others believe guidelines facilitate collection objective reproducible evidence depth breadth architectures support cognition relationship human natural cognition intend publish results special issue international journal archive presentation slides explanatory material active web site key issues discussion following key questions raised motivate workshop discussion goal providing answers least steps towards answers within workshop underlying research hypotheses one explores architectures functionscharacteristics turn architecture architecture supporting intelligence architectures compared informative manner evaluation methods needed different types cognitive architectures criteria scales evaluation validate design cognitive architecture relevant formal methods prove properties architectures develop common ontology describing architectures andor various sets requirements evaluated datasets benchmarks standardized tasks used evaluate architectures useful casestudies determine architectures use different tasks environments tradeoffs involved format submissions workshop composed invited contributed talks evaluation methodologies interleaved panels moderated discussions seek submission extended abstracts 2 pages short position papers 4 pages discuss evaluation methodologies architectures submissions clearly address architecture evaluation issues methods explicitly relate one questions posed submissions discuss specific architectures acceptable discuss evaluation casestudies selected group contributors invited present position participate panels andor moderate group discussions submissions aaai format emailed april 15 2007 gal kaminka zltzcsbiuacil catherina burghart nhoroytiiraukade subject line containing archeval submission important dates submission extended abstracts april 15 2007 notification selection speakers may 7 2007 cameraready copy workshop material may 15 2007 workshop aaai 2007 july 2223 2007 organizers workshop cochaired gal kaminka bar ilan university israel catherina r burghart university karlsruhe germany organizing committee additionally includes kevin gluck air force research laboratory usa pat langley stanford university usa brian logan university nottingham uk ralf mikut karlsruhe institute technology germany praveen paritosh northwestern university usa bilge say middle east technical university turkey robert wray soar technology inc usa gal kaminka phd httpwwwcsbiuacilgalk assistant professor computer science dept bar ilan university see invisible impossible death engineering problem bart kosko fuzzy thinking life engineering task gal kaminka gal kaminka phd httpwwwcsbiuacilgalk assistant professor computer science dept bar ilan university see invisible impossible death engineering problem bart kosko fuzzy thinking life engineering task gal kaminka fri 08 aug 2008 003520 0300 uai cfp evaluating architectures intelligence