501-550 of 10000 results (38ms)
2017-04-11 ยง
16:43 <switchdc> (oblivian@sarin) END TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Successfully completed [production]
16:43 <mobrovac@tin> Finished deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 (duration: 01m 33s) [production]
16:42 <ppchelko@tin> Finished deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 (duration: 04m 28s) [production]
16:41 <mobrovac@tin> Started deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 [production]
16:40 <switchdc> (oblivian@sarin) START TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Switch traffic flow to the appservers in the new datacenter [production]
16:37 <ppchelko@tin> Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 [production]
16:37 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: donatewiki still busted [production]
16:35 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: donatewiki back to wmf.19 [production]
16:33 <mobrovac@tin> Finished deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 (duration: 01m 04s) [production]
16:32 <switchdc> (oblivian@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed [production]
16:32 <mobrovac@tin> Started deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 [production]
16:28 <mobrovac> restbase disabling puppet for T116335 [production]
16:27 <demon@tin> Synchronized README: no-op, co-master sync (duration: 00m 43s) [production]
16:24 <switchdc> (oblivian@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches [production]
16:11 <switchdc> (volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed [production]
16:08 <switchdc> (volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches [production]
16:08 <volans> testing the codfw caches wipe+warm, take 2 [production]
16:04 <demon@tin> Synchronized scap/plugins/clean.py: syncing to both masters (duration: 00m 44s) [production]
15:56 <switchdc> (volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Failed to execute [production]
15:54 <switchdc> (volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches [production]
15:53 <volans> testing the codfw caches wipe+warm: https://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_4.1_-_Wipe_caches T160178 [production]
15:25 <thcipriani@tin> Synchronized README: test sync for new scap version 3.5.5 (duration: 00m 59s) [production]
15:19 <godog> upload scap 3.5.5-1 - T127762 [production]
15:05 <ema> upgrade cp4005 (cache_upload) to linux 4.9 T162029 [production]
14:31 <moritzm> powercycled restbase1007, stuck during reboot [production]
14:18 <moritzm> upgrading restbase1007 to Linux 4.9 [production]
13:55 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:343438|Enable RCFilters beta feature on fawiki, ruwiki, trwiki, and frwiki (T144458)]] (duration: 00m 39s) [production]
13:54 <ottomata> reimaging stat1004 as jessie [production]
13:53 <akosiaris> upgrade puppet agent to 3.8 across the jessie fleet. Do that in a stages, starting with parsoid hosts. move on to mw fleet next. T162462 [production]
13:51 <akosiaris> upgrade puppet agent to 3.8 across the jessie fleet. Do that in a stages, starting with parsoid hosts [production]
13:49 <godog> roll-upgrade swift to 2.2.0 across eqiad machines - T162609 [production]
13:45 <hashar> Updating all Jenkins jobs using the git plugin due to JJB change cdfeb7bf66b0eacfed3eaf2a77813d65ab0e29f2 - https://phabricator.wikimedia.org/T162674 [production]
13:39 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:345965|Add autopatrolled group to svwiktionary (T161919)]] (duration: 00m 39s) [production]
13:34 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:347436|Increase default image thumbnail size on Finnish Wikipedia to 250px (T162376)]] (duration: 00m 39s) [production]
13:10 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:347166|Give sysops ability to promote users to eliminator at fawiki (T162396)]] (duration: 00m 39s) [production]
13:01 <godog> roll-upgrade swift to 2.2.0 across codfw machines - T162609 [production]
12:55 <moritzm> powercycling wtp2013, stuck during reboot [production]
12:47 <elukey> reimage mw2246 (Debian codfw videoscaler) to Trusty [production]
12:46 <marostegui> Deploy schema change on db1069 (s7 instance) - T160390 [production]
11:42 <ema> upgrade cache_misc to linux 4.9 T162029 [production]
11:33 <elukey> resume reboot of analytics1040->1050 for kernel upgrades [production]
11:27 <moritzm> wtp2* to Linux 4.9 [production]
11:27 <addshore@tin> Synchronized wmf-config/InitialiseSettings-labs.php: NOOP (Beta file only) - [[gerrit:347592|Remove redundant wmgUseRevisionSlider in InitialiseSettings-labs]] (duration: 00m 38s) [production]
11:09 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: NOOP - [[gerrit:347584|Remove redundant testwiki from wmgUseLinter (already has group0)]] (duration: 00m 39s) [production]
11:02 <addshore@tin> Synchronized wmf-config/InitialiseSettings-labs.php: NOOP (Beta file only) - Fix some tabs (duration: 00m 39s) [production]
10:46 <moritzm> upgrading wtp1020-wtp1024 to Linux 4.9 [production]
10:13 <moritzm> upgrading wtp1010-wtp1019 to Linux 4.9 [production]
09:17 <moritzm> install remaining pam updates from jessie point update [production]
09:11 <godog> upgrade swift to 2.2.0 on ms-be2001 - T162609 [production]
06:58 <moritzm> restarted cassandra-a on restbase2004, crashed with "out of heap memory" [production]