2401-2450 of 10000 results (40ms)
2017-04-11 ยง
17:02 <marostegui> Deploy unscheduled alter table on db1038 (s3, image table) - T160415 [production]
17:02 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: nope, no wmf.19 for donatewiki. life is hard [production]
17:01 <mobrovac@tin> Started deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy, take 2 - T116335 [production]
17:01 <ppchelko@tin> Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001, attempt#2 T160764 [production]
17:00 <marostegui> Deploy unscheduled alter table on db1035 (s3, image table) - T160415 [production]
16:58 <marostegui> Deploy unscheduled alter table on db1077 (s3, image table) - T160415 [production]
16:56 <marostegui> Deploy unscheduled alter table on db1078 (s3, image table) - T160415 [production]
16:54 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: donatewiki back to wmf.19. you put your left foot in, you put your left foot out... [production]
16:48 <marostegui> Deploy unscheduled alter table on db1093 (adding pl_from index) [production]
16:45 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1093 (duration: 00m 42s) [production]
16:43 <switchdc> (oblivian@sarin) END TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Successfully completed [production]
16:43 <mobrovac@tin> Finished deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 (duration: 01m 33s) [production]
16:42 <ppchelko@tin> Finished deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 (duration: 04m 28s) [production]
16:41 <mobrovac@tin> Started deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 [production]
16:40 <switchdc> (oblivian@sarin) START TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Switch traffic flow to the appservers in the new datacenter [production]
16:37 <ppchelko@tin> Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 [production]
16:37 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: donatewiki still busted [production]
16:35 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: donatewiki back to wmf.19 [production]
16:33 <mobrovac@tin> Finished deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 (duration: 01m 04s) [production]
16:32 <switchdc> (oblivian@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed [production]
16:32 <mobrovac@tin> Started deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 [production]
16:28 <mobrovac> restbase disabling puppet for T116335 [production]
16:27 <demon@tin> Synchronized README: no-op, co-master sync (duration: 00m 43s) [production]
16:24 <switchdc> (oblivian@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches [production]
16:11 <switchdc> (volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed [production]
16:08 <switchdc> (volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches [production]
16:08 <volans> testing the codfw caches wipe+warm, take 2 [production]
16:04 <demon@tin> Synchronized scap/plugins/clean.py: syncing to both masters (duration: 00m 44s) [production]
15:56 <switchdc> (volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Failed to execute [production]
15:54 <switchdc> (volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches [production]
15:53 <volans> testing the codfw caches wipe+warm: https://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_4.1_-_Wipe_caches T160178 [production]
15:25 <thcipriani@tin> Synchronized README: test sync for new scap version 3.5.5 (duration: 00m 59s) [production]
15:19 <godog> upload scap 3.5.5-1 - T127762 [production]
15:05 <ema> upgrade cp4005 (cache_upload) to linux 4.9 T162029 [production]
14:31 <moritzm> powercycled restbase1007, stuck during reboot [production]
14:18 <moritzm> upgrading restbase1007 to Linux 4.9 [production]
13:55 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:343438|Enable RCFilters beta feature on fawiki, ruwiki, trwiki, and frwiki (T144458)]] (duration: 00m 39s) [production]
13:54 <ottomata> reimaging stat1004 as jessie [production]
13:53 <akosiaris> upgrade puppet agent to 3.8 across the jessie fleet. Do that in a stages, starting with parsoid hosts. move on to mw fleet next. T162462 [production]
13:51 <akosiaris> upgrade puppet agent to 3.8 across the jessie fleet. Do that in a stages, starting with parsoid hosts [production]
13:49 <godog> roll-upgrade swift to 2.2.0 across eqiad machines - T162609 [production]
13:45 <hashar> Updating all Jenkins jobs using the git plugin due to JJB change cdfeb7bf66b0eacfed3eaf2a77813d65ab0e29f2 - https://phabricator.wikimedia.org/T162674 [production]
13:39 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:345965|Add autopatrolled group to svwiktionary (T161919)]] (duration: 00m 39s) [production]
13:34 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:347436|Increase default image thumbnail size on Finnish Wikipedia to 250px (T162376)]] (duration: 00m 39s) [production]
13:10 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:347166|Give sysops ability to promote users to eliminator at fawiki (T162396)]] (duration: 00m 39s) [production]
13:01 <godog> roll-upgrade swift to 2.2.0 across codfw machines - T162609 [production]
12:55 <moritzm> powercycling wtp2013, stuck during reboot [production]
12:47 <elukey> reimage mw2246 (Debian codfw videoscaler) to Trusty [production]
12:46 <marostegui> Deploy schema change on db1069 (s7 instance) - T160390 [production]
11:42 <ema> upgrade cache_misc to linux 4.9 T162029 [production]