trent nelson ktctpxaonresolvecom yeah test_tokenize weird ive looking well heres sample failure windows buildbot file sbuildbotspython30nelsonwindowsbuildlibtesttest_tokenizepy line testtest_tokenize__test__doctests failed example testfile testfiles roundtripopentestfile break else true exception raised traceback recent call last file sbuildbotspython30nelsonwindowsbuildlibdoctestpy line 1227 __run compileflags 1 testglobs file line 2 roundtripopentestfile break file line 3 roundtrip token_list listgenerate_tokensfreadline file sbuildbotspython30nelsonwindowsbuildlibtokenizepy line 264 generate_tokens line readline file sbuildbotspython30nelsonwindowsbuildlibiopy line 1467 readline readahead pending self_read_chunk file sbuildbotspython30nelsonwindowsbuildlibiopy line 1278 _read_chunk pending self_decoderdecodereadahead readahead file sbuildbotspython30nelsonwindowsbuildlibiopy line 1081 decode output selfdecoderdecodeinput finalfinal file sbuildbotspython30nelsonwindowsbuildlibencodingscp1252py line 23 decode return codecscharmap_decodeinputselferrorsdecoding_table0 unicodedecodeerror charmap codec cant decode byte 0x81 position 17 character maps following end doctests test_tokenize tempdir ospathdirnamef oscurdir testfiles globglobospathjointempdir testpy test_supportis_resource_enabledcompiler testfiles randomsampletestfiles 10 testfile testfiles roundtripopentestfile break else true true first line f libtesttokenize_teststxt basically grabbing ten random testpy files libtest running untokenizegenerate_tokensfreadline one order figure file dying added following test_tokenizepy def test_tokenize_all import glob import os tempdir ospathdirname__file__ oscurdir testfiles globglobospathjointempdir testpy file testfiles printprocessing file file printroundtripopenfile roundtripopenfile results different results python 30a3 py3k mar 16 2008 104145 msc v1500 32 bit intel win32 type help copyright credits license information test import test_tokenize 50808 refs test_tokenizetest_tokenize_all processing file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtesttestcodecpy traceback recent call last file line 1 file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtesttest_tokenizepy line 565 test_tokenize_all printroundtripopenfile roundtripopenfile file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtesttest_tokenizepy line 514 roundtrip source untokenizegenerate_tokensfreadline file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtokenizepy line 238 untokenize return utuntokenizeiterable file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtokenizepy line 183 untokenize selfadd_whitespacestart file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtokenizepy line 172 add_whitespace assert row selfprev_row assertionerror 52668 refs yay make even interesting ssrcsvnsvnpythonorgprojectspythonbranchespy3kpcbuildpython_d libtesttest_tokenizepy doctest testtest_tokenize 62 tests zero failures 61919 refs oh ssrcsvnsvnpythonorgprojectspythonbranchespy3kpcbuildpython_d libtestregrtestpy q uall rw test_tokenize file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtesttest_tokenizepy line testtest_tokenize__test__doc tests failed example testfile testfiles roundtripopentestfile break else true exception raised traceback recent call last file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibdoctestpy line 1227 __run compileflags 1 testglobs file line 2 roundtripopentestfile break file line 3 roundtrip token_list listgenerate_tokensfreadline file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibtokenizepy line 264 generate_tokens line readline file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibiopy line 1467 readline readahead pending self_read_chunk file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibiopy line 1278 _read_chunk pending self_decoderdecodereadahead readahead file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibiopy line 1081 decode output selfdecoderdecodeinput finalfinal file ssrcsvnsvnpythonorgprojectspythonbranchespy3klibencodingscp1252py line 23 decode return codecscharmap_decodeinputselferrorsdecoding_table0 unicodedecodeerror charmap codec cant decode byte 0x81 position 17 character maps 1 items failures 1 57 testtest_tokenize__test__doctests test failed 1 failures test test_tokenize failed 1 62 doctests failed 1 test failed test_tokenize trent ________________________________________ lnmudhrdtmzckqvwlnmudhrdtmzckqvwlnmpythonorg lnmudhrdtmzckqvwlnmudhrdtmzckqvwlnmpythonorg behalf mark dickinson vqpxmqtcgmailcom sent 16 march 2008 1813 python dev subject pythondev 30 buildbots red sun mar 16 2008 132 pm neal norwitz wrote think possible though considerable work probably biggest win creating mock socket using mock sockets tests asyncorechat smtplib xmlrpc etc fix 75 problems 26 remaining problems test_asynchatcore might meaningful mock sockets flaky alpha fails test_signalsocket weird alarm conditions might hard debugfix access box though test_sqlite broken x86 old sqlite access box test_bsddb may flaky im sure probably platform specific problems test_tokenize also currently sometimes failing many bots ive looking im struggling find problem traceback eg amd64 gentoo buildbot ends file homebuildbotslavepybuild30norwitzamd64buildlibiopy line 1081 decode output selfdecoderdecodeinput finalfinal file homebuildbotslavepybuild30norwitzamd64buildlibcodecspy line 291 decode result consumed self_buffer_decodedata selferrors final unicodedecodeerror utf8 codec cant decode bytes position 1215 invalid data machine suse 93i686 im seeing test pass 80 time fail 20 something like position reported invalid data changing run run looks like data getting corrupted somewhere along line anyone ideas mark _______________________________________________ pythondev mailing list zvlllneumpythonorg httpmailpythonorgmailmanlistinfopythondev unsubscribe httpmailpythonorgmailmanoptionspythondevtnelson40onresolvecom _______________________________________________ pythondev mailing list zvlllneumpythonorg httpmailpythonorgmailmanlistinfopythondev unsubscribe httpmailpythonorgmailmanoptionspythondevpythondev40tangomucom wed 06 aug 2008 042612 0700 pythondev 30 buildbots red