2019-01-18
§
|
16:14 |
<arturo> |
T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch) |
[production] |
15:36 |
<moritzm> |
rebooting mwdebug servers in codfw to pick up SSBD-enabled qemu |
[production] |
15:27 |
<moritzm> |
rebooting elnath to pick up SSBD-enabled qemu |
[production] |
13:41 |
<marostegui> |
reload haproxy on dbproxy1004 |
[production] |
13:18 |
<godog> |
start cassandra-a on restbase1016 - T212418 |
[production] |
13:07 |
<mbsantos@deploy1001> |
Finished deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed (duration: 00m 45s) |
[production] |
13:06 |
<mbsantos@deploy1001> |
Started deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed |
[production] |
12:50 |
<moritzm> |
uploaded ferm 2.4-1+wmf1 to buster-wikimedia (T213527) |
[production] |
11:46 |
<moritzm> |
copied prometheus-rsyslog-exporter from stretch-wikimedia to buster-wikimedia |
[production] |
11:09 |
<marostegui> |
Deploy schema change on db2039 (s6 codfw master) - T210713 |
[production] |
10:54 |
<marostegui> |
Deploy schema change on dbstore2001:3316 - T210713 |
[production] |
10:42 |
<jynus> |
killing and removing data from db1118 |
[production] |
10:41 |
<marostegui> |
Deploy schema change on db2076 - T210713 |
[production] |
10:29 |
<vgutierrez> |
restarting pybal in lvs2002 - T214072 |
[production] |
10:23 |
<marostegui> |
Deploy schema change on db2087:3316 - T210713 |
[production] |
10:23 |
<vgutierrez> |
restarting pybal in lvs2005 - T214072 |
[production] |
10:02 |
<marostegui> |
Add dbstore1003:3315 to zarcillo - T210478 |
[production] |
09:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 - T210478 (duration: 00m 45s) |
[production] |
09:57 |
<marostegui> |
Add dbstore1003:3315 to tendril - T210478 |
[production] |
09:52 |
<marostegui> |
Deploy schema change on db2089 - T210713 |
[production] |
09:35 |
<marostegui> |
Deploy schema change on db2067 - T210713 |
[production] |
09:29 |
<_joe_> |
uploading python{,3}-pygerrit2 to stretch-wikimedia, T214149 |
[production] |
09:23 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Add migrated wikis from s3 to s5 to codfw config T184805 (duration: 00m 45s) |
[production] |
09:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 after mysql upgrade (duration: 00m 46s) |
[production] |
08:12 |
<godog> |
depool and take snapshots of prometheus data on prometheus2003 to test v2 conversion - T187987 |
[production] |
07:31 |
<moritzm> |
rolling restart of AQS to pick up OpenSSL security updates for nodejs |
[production] |
07:30 |
<marostegui> |
Stop MySQL on db1113:3315 and db1113:3316 to clone dbstore1003 and for mysql and kernel upgrade |
[production] |
07:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 for mysql upgrade (duration: 00m 45s) |
[production] |
07:24 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1113:3315 - T210478 (duration: 00m 46s) |
[production] |
07:16 |
<moritzm> |
installing OpenSSL security updates |
[production] |
06:54 |
<marostegui> |
Drop table tag_summary from s7 - T212255 |
[production] |
06:46 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1075 and db1103 after DC hw maintenance (duration: 00m 44s) |
[production] |
06:46 |
<marostegui> |
Deploy schema change on dbstore1002:s3 - T85757 |
[production] |
06:29 |
<marostegui> |
Deploy schema change on db1075 - T85757 |
[production] |
06:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool DBs on A2 rack T213748 (duration: 00m 47s) |
[production] |
00:00 |
<ejegg> |
updated payments-wiki from c455bbc6bb to 7d4cd165d9 |
[production] |
2019-01-17
§
|
23:02 |
<bsitzmann@deploy1001> |
Finished deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try (duration: 02m 03s) |
[production] |
23:00 |
<bsitzmann@deploy1001> |
Started deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try |
[production] |
20:06 |
<dduvall@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.13 |
[production] |
19:29 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/GrowthExperiments/: Make welcome survey C unescapable (T213958) (duration: 00m 52s) |
[production] |
19:16 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Update groupOverrides for Serbian wikis (T213055, T213059, T213063, T213065, T213679, T213680, T213681, T213682, T213684, T213685, T213686, T213687, T213824, T213825, T213826, T213827, T213828, T213829, T213830, T213832) (duration: 00m 53s) |
[production] |
19:02 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Update recommendation api endpoints (duration: 20m 26s) |
[production] |
18:42 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Update recommendation api endpoints |
[production] |
18:22 |
<vgutierrez> |
running ipvsadm -D -t 10.2.1.29:1968 in lvs2003 - T214041 |
[production] |
18:19 |
<vgutierrez> |
running ipvsadm -D -t 10.2.1.29:1968 in lvs2006 - T214041 |
[production] |
18:18 |
<bmansurov@deploy1001> |
Finished deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 (duration: 05m 36s) |
[production] |
18:12 |
<bmansurov@deploy1001> |
Started deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 |
[production] |
17:52 |
<elukey> |
re-enable eventlogging mysql clients and db1108's el replication after db1107 maintenance |
[production] |
17:38 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs on wikidatawiki (5% of edits) T204031 (duration: 00m 52s) |
[production] |
17:25 |
<dcausse> |
restarting mjolnir services on all elastic* nodes |
[production] |