4351-4400 of 10000 results (59ms)
2018-01-16 §
08:11 <jynus> start x1 eqiad master failover [production]
08:02 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1055 and db1056 after maintenance (duration: 00m 49s) [production]
07:42 <jynus> moving replication topology of x1 replicas [production]
07:34 <marostegui> Deploy schema change on dbstore1001 (s8) - T174569 [production]
07:30 <marostegui> Stop replication in sync db1066 and db1089 - T162807 [production]
07:30 <jynus> upgrade and reboot db1056 [production]
07:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1066 and db1089 - T162807 (duration: 01m 13s) [production]
07:29 <oblivian@neodymium> conftool action : set/weight=25; selector: name=mw1340.eqiad.wmnet [production]
07:17 <jynus> upgrade and reboot db1055 [production]
07:14 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1055 and db1056 for maintenance (duration: 01m 12s) [production]
07:03 <marostegui> Deploy schema change on dbstore1002 (s8) - T174569 [production]
06:32 <marostegui> Deploy schema change on db1092 - T174569 [production]
06:24 <marostegui> Upgrade kernel on db1092 [production]
06:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1092 - T174569 (duration: 01m 32s) [production]
02:24 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.15) (duration: 06m 10s) [production]
2018-01-15 §
23:40 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: turn educationprogram back on for cs.wikipedia -- turns out there was no consensus and a patch should never have been written 😡 (duration: 01m 13s) [production]
18:50 <_joe_> pooled mw1340 as an api appserver [production]
18:43 <oblivian@puppetmaster1001> conftool action : set/pooled=active; selector: name=mw1338.eqiad.wmnet [production]
18:42 <oblivian@neodymium> conftool action : set/pooled=active; selector: name=mw1338.eqiad.wmnet [production]
18:34 <oblivian@neodymium> conftool action : set/pooled=active; selector: name=mw1338.eqiad.wmnet [production]
18:01 <moritzm> uploading HHVM 3.18.7 (3.18.5+dfsg-1+wmf3) for jessie-wikimedia to apt.wikimedia.org [production]
17:44 <moritzm> updating HHVM in deployment-prep to HHVM 3.18.7 [production]
17:08 <godog> bootstrap cassandra-c on restbase1017 [production]
16:53 <jynus> upgrade and restart db2018 [production]
16:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 and db1089 - T162807 (duration: 01m 12s) [production]
16:49 <jynus> finished codfw s3 master switchover [production]
16:49 <jynus@tin> Synchronized wmf-config/db-codfw.php: Switchover s3 codfw master from db2018 to db2036 (duration: 01m 12s) [production]
16:41 <_joe_> restarting hhvm on mw1227, threads stuck in HPHP::jit::enterTCImpl [production]
16:31 <marostegui> Force WB on db2033 - T184888 [production]
16:24 <jynus> restarting db2036 to set as master [production]
16:20 <jynus> starting codfw s3 master switchover [production]
15:55 <marostegui> Stop replication in sync db1067 and db1089 - T162807 [production]
15:52 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1067 and db1089 - T162807 (duration: 01m 12s) [production]
15:44 <jynus> upgrade and restart db2074 [production]
15:33 <jynus> upgrade and restart db2057 [production]
15:08 <jynus> upgrade and restart db2050 [production]
14:58 <jynus> upgrade and restart db2043 [production]
14:46 <jynus> upgrade and restart db2036 [production]
14:41 <zeljkof> EU SWAT finished [production]
14:40 <zfilipin@tin> Synchronized php-1.31.0-wmf.16/extensions/ContentTranslation: SWAT: [[gerrit:404070|CX1: Fix translation view UI overlaps (T184662 T184130)]] (duration: 01m 16s) [production]
14:08 <ladsgroup@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:404298|Enable lua fine grained usage tracking in some wikis (T184322)]] (duration: 01m 14s) [production]
14:05 <moritzm> reboot rdb* hosts in codfw for kernel security update [production]
13:41 <gehel> starting rolling reboot of elasticsearch / cirrus eqiad for kernel upgrade [production]
13:38 <elukey> reboot eventlog1001 for kernel updates [production]
13:20 <elukey> reboot kafka2003 for kernel upgrades [production]
12:04 <jynus> upgrade and restart db2017 [production]
11:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1065 - T162807 (duration: 01m 12s) [production]
11:54 <moritzm> rebooting ores1* for kernel security update [production]
11:48 <elukey> reboot aqs1007 for kernel upgrades [production]
11:36 <oblivian@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw13(3[8-9]|4[0-9]).* [production]