3001-3050 of 10000 results (83ms)
2019-01-18 §
16:14 <arturo> T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch) [production]
15:36 <moritzm> rebooting mwdebug servers in codfw to pick up SSBD-enabled qemu [production]
15:27 <moritzm> rebooting elnath to pick up SSBD-enabled qemu [production]
13:41 <marostegui> reload haproxy on dbproxy1004 [production]
13:18 <godog> start cassandra-a on restbase1016 - T212418 [production]
13:07 <mbsantos@deploy1001> Finished deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed (duration: 00m 45s) [production]
13:06 <mbsantos@deploy1001> Started deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed [production]
12:50 <moritzm> uploaded ferm 2.4-1+wmf1 to buster-wikimedia (T213527) [production]
11:46 <moritzm> copied prometheus-rsyslog-exporter from stretch-wikimedia to buster-wikimedia [production]
11:09 <marostegui> Deploy schema change on db2039 (s6 codfw master) - T210713 [production]
10:54 <marostegui> Deploy schema change on dbstore2001:3316 - T210713 [production]
10:42 <jynus> killing and removing data from db1118 [production]
10:41 <marostegui> Deploy schema change on db2076 - T210713 [production]
10:29 <vgutierrez> restarting pybal in lvs2002 - T214072 [production]
10:23 <marostegui> Deploy schema change on db2087:3316 - T210713 [production]
10:23 <vgutierrez> restarting pybal in lvs2005 - T214072 [production]
10:02 <marostegui> Add dbstore1003:3315 to zarcillo - T210478 [production]
09:58 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 - T210478 (duration: 00m 45s) [production]
09:57 <marostegui> Add dbstore1003:3315 to tendril - T210478 [production]
09:52 <marostegui> Deploy schema change on db2089 - T210713 [production]
09:35 <marostegui> Deploy schema change on db2067 - T210713 [production]
09:29 <_joe_> uploading python{,3}-pygerrit2 to stretch-wikimedia, T214149 [production]
09:23 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Add migrated wikis from s3 to s5 to codfw config T184805 (duration: 00m 45s) [production]
09:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 after mysql upgrade (duration: 00m 46s) [production]
08:12 <godog> depool and take snapshots of prometheus data on prometheus2003 to test v2 conversion - T187987 [production]
07:31 <moritzm> rolling restart of AQS to pick up OpenSSL security updates for nodejs [production]
07:30 <marostegui> Stop MySQL on db1113:3315 and db1113:3316 to clone dbstore1003 and for mysql and kernel upgrade [production]
07:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 for mysql upgrade (duration: 00m 45s) [production]
07:24 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1113:3315 - T210478 (duration: 00m 46s) [production]
07:16 <moritzm> installing OpenSSL security updates [production]
06:54 <marostegui> Drop table tag_summary from s7 - T212255 [production]
06:46 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1075 and db1103 after DC hw maintenance (duration: 00m 44s) [production]
06:46 <marostegui> Deploy schema change on dbstore1002:s3 - T85757 [production]
06:29 <marostegui> Deploy schema change on db1075 - T85757 [production]
06:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool DBs on A2 rack T213748 (duration: 00m 47s) [production]
00:00 <ejegg> updated payments-wiki from c455bbc6bb to 7d4cd165d9 [production]
2019-01-17 §
23:02 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try (duration: 02m 03s) [production]
23:00 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try [production]
20:06 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.13 [production]
19:29 <catrope@deploy1001> Synchronized php-1.33.0-wmf.13/extensions/GrowthExperiments/: Make welcome survey C unescapable (T213958) (duration: 00m 52s) [production]
19:16 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Update groupOverrides for Serbian wikis (T213055, T213059, T213063, T213065, T213679, T213680, T213681, T213682, T213684, T213685, T213686, T213687, T213824, T213825, T213826, T213827, T213828, T213829, T213830, T213832) (duration: 00m 53s) [production]
19:02 <ppchelko@deploy1001> Finished deploy [restbase/deploy@f24d681]: Update recommendation api endpoints (duration: 20m 26s) [production]
18:42 <ppchelko@deploy1001> Started deploy [restbase/deploy@f24d681]: Update recommendation api endpoints [production]
18:22 <vgutierrez> running ipvsadm -D -t 10.2.1.29:1968 in lvs2003 - T214041 [production]
18:19 <vgutierrez> running ipvsadm -D -t 10.2.1.29:1968 in lvs2006 - T214041 [production]
18:18 <bmansurov@deploy1001> Finished deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 (duration: 05m 36s) [production]
18:12 <bmansurov@deploy1001> Started deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 [production]
17:52 <elukey> re-enable eventlogging mysql clients and db1108's el replication after db1107 maintenance [production]
17:38 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs on wikidatawiki (5% of edits) T204031 (duration: 00m 52s) [production]
17:25 <dcausse> restarting mjolnir services on all elastic* nodes [production]