kenneth lareau mritplcxnnominumcom folks hopefully email wont get long im bit situation think im need outside suggestions theres desire make buildbot bit company cur rently including handling release builds grunt work us shortterm release branches changes requiring look upgrading buildbot latest version effective load balancing minimize times leads wonder might hit problems moving customization current configuration running version 074 turn mailing list possible assistance im going try describe current configuration insuf ficient need try desensitize post start tool thats used manage assist building products relatively complex due deep level dependencies tool handles updating call build root along actually performing builds written top scons suspect many familiar due use buildbot rather unique create builders simply call set shell commands tool perform various steps build current breakdown steps follows update buildroot perform build product copy resulting tarballpackage archive area run regression tests first two steps handled shell commands utilizing tool final two steps handled shell command calling various scripts python perl shell since theres sufficient variation products built tested buildbot configuration creates set slave objects hold various pieces information build slaves object contains following name buildslave dictionary products platforms theyre built dictionary versions supported product dictionary current release builds products theres also variables note whether buildslave contin uous build system normal mode buildbot special bench marking system slaves objects created slavelock created buildslave tool effectively locks buildroot system prevents simultaneous update build processes occurring good thing case build factory generated product supported buildslave given information slave object determines kind build needs done given product instantiates class generates appropriate build steps product version release type builders created schedulers created three kinds schedulers configuration nightly builds run given time evening continuous builds benchmarking builds dependent key nightly builds start times nightly builds staggered minute prevent possible repository access contention happens much less subversion cvs still occur many systems try update product simultaneously benchmarking builds run certain builds given plat form successful builds testing final part configuration sets status targets currently web mail notification web side five different interfaces waterfall default grid special overview page builders text used commandline tools rss want rss feeds buildtimes view build times changed time waterfall display custom interfaces final note debugging port also enabled rarely used currently works fine additional builders created new release along release things might get bit hairy already 167 builders number grow significantly change text file read configuration allows different product builds easily added removed buildbot keeping track things may get painful changes put effect cover one issue im dealing grid interface via web created could complete overview builders fit mostly onto single page unlike waterfall page could scroll long time 167 builders grid basically set rows represent build slave set columns represent product given version said product grid filled information pair actually associated builder upcoming increase slaves product versions existing given time configuration ever scrolling might become issue one idea ive come modify grid view load balanced rows could collapsed single row expanded detail needed work fine since given builder would run single slave given time expansion would see builder ran similar thing could done columns product runs issue one builder represented row collapse im uncertain best way handle may end simple hiding mechanism nonnightly columns expanded need looked still way know theres issue hidden column suggestions welcome issue thats concerning im uncertain attempting use load balancing affect way current configuration constructed realize detail actual configu ration might needed anyone truly answer though part cant help wonder theres simpler way basically ive working configuration designed someone ive completely refactored code mastercfg make easier maintain addi tional code custom htmlpy file files still need lot work might end challenge com pletely necessary upgrade think covers current state ive considered unclear folks please let know ill best clarify expand ive already said im pretty certain need post configuration able take bit work needed help willing undertake anyone suggestions proceed perchance ken lareau sfnet email sponsored splunk inc still grepping log files find problems stop search log events configuration files using ajax browser download free copy splunk httpgetsplunkcom wed 06 aug 2008 200653 0700 buildbotdevel facing possible challenges buildbot opinions requested