|
2019-01-18
§
|
| 08:12 |
<godog> |
depool and take snapshots of prometheus data on prometheus2003 to test v2 conversion - T187987 |
[production] |
| 07:31 |
<moritzm> |
rolling restart of AQS to pick up OpenSSL security updates for nodejs |
[production] |
| 07:30 |
<marostegui> |
Stop MySQL on db1113:3315 and db1113:3316 to clone dbstore1003 and for mysql and kernel upgrade |
[production] |
| 07:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 for mysql upgrade (duration: 00m 45s) |
[production] |
| 07:24 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1113:3315 - T210478 (duration: 00m 46s) |
[production] |
| 07:16 |
<moritzm> |
installing OpenSSL security updates |
[production] |
| 06:54 |
<marostegui> |
Drop table tag_summary from s7 - T212255 |
[production] |
| 06:46 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1075 and db1103 after DC hw maintenance (duration: 00m 44s) |
[production] |
| 06:46 |
<marostegui> |
Deploy schema change on dbstore1002:s3 - T85757 |
[production] |
| 06:29 |
<marostegui> |
Deploy schema change on db1075 - T85757 |
[production] |
| 06:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool DBs on A2 rack T213748 (duration: 00m 47s) |
[production] |
| 00:00 |
<ejegg> |
updated payments-wiki from c455bbc6bb to 7d4cd165d9 |
[production] |
|
2019-01-17
§
|
| 23:02 |
<bsitzmann@deploy1001> |
Finished deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try (duration: 02m 03s) |
[production] |
| 23:00 |
<bsitzmann@deploy1001> |
Started deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try |
[production] |
| 20:06 |
<dduvall@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.13 |
[production] |
| 19:29 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/GrowthExperiments/: Make welcome survey C unescapable (T213958) (duration: 00m 52s) |
[production] |
| 19:16 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Update groupOverrides for Serbian wikis (T213055, T213059, T213063, T213065, T213679, T213680, T213681, T213682, T213684, T213685, T213686, T213687, T213824, T213825, T213826, T213827, T213828, T213829, T213830, T213832) (duration: 00m 53s) |
[production] |
| 19:02 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Update recommendation api endpoints (duration: 20m 26s) |
[production] |
| 18:42 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Update recommendation api endpoints |
[production] |
| 18:22 |
<vgutierrez> |
running ipvsadm -D -t 10.2.1.29:1968 in lvs2003 - T214041 |
[production] |
| 18:19 |
<vgutierrez> |
running ipvsadm -D -t 10.2.1.29:1968 in lvs2006 - T214041 |
[production] |
| 18:18 |
<bmansurov@deploy1001> |
Finished deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 (duration: 05m 36s) |
[production] |
| 18:12 |
<bmansurov@deploy1001> |
Started deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 |
[production] |
| 17:52 |
<elukey> |
re-enable eventlogging mysql clients and db1108's el replication after db1107 maintenance |
[production] |
| 17:38 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs on wikidatawiki (5% of edits) T204031 (duration: 00m 52s) |
[production] |
| 17:25 |
<dcausse> |
restarting mjolnir services on all elastic* nodes |
[production] |
| 17:19 |
<dcausse@deploy1001> |
Finished deploy [search/mjolnir/deploy@85aec7a]: fix multi-instances support (duration: 03m 42s) |
[production] |
| 17:15 |
<dcausse@deploy1001> |
Started deploy [search/mjolnir/deploy@85aec7a]: fix multi-instances support |
[production] |
| 16:57 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.12/extensions/VisualEditor/modules/ve-mw/: T213922: Revert 48db45df7602 for wmf.12 (duration: 00m 52s) |
[production] |
| 16:56 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/VisualEditor/modules/ve-mw/: T213922: Revert 48db45df7602 for wmf.13 (duration: 00m 51s) |
[production] |
| 16:46 |
<dcausse@deploy1001> |
Finished deploy [search/mjolnir/deploy@42414ca]: add support for multi-instances setup (duration: 04m 59s) |
[production] |
| 16:45 |
<paravoid> |
updating ps1-a3-eqiad's SNMP communities to the new ones |
[production] |
| 16:41 |
<dcausse@deploy1001> |
Started deploy [search/mjolnir/deploy@42414ca]: add support for multi-instances setup |
[production] |
| 16:28 |
<fsero> |
uncordoned kubernetes1001 |
[production] |
| 16:27 |
<fsero@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=kubernetes1001.eqiad.wmnet |
[production] |
| 16:19 |
<moritzm> |
rebooting roentgenium (failoid node in eqiad) to enable SSBD-enabled qemu |
[production] |
| 16:18 |
<cmjohnson1> |
ps1-a2-eqiad removing redundant power from side A to replace blown fuse |
[production] |
| 16:16 |
<moritzm> |
rebooting tureis (failoid node in codfw) to enable SSBD-enabled qemu |
[production] |
| 15:12 |
<moritzm> |
rebooting archiva1001 (archiva.wikimedia.org) to enable SSBD-enabled qemu |
[production] |
| 14:49 |
<moritzm> |
rebooting darmstadtium (docker registry) to enable SSBD-enabled qemu |
[production] |
| 14:36 |
<jbond42> |
rolling out update for debdeploy 0.0.99.6-1 -> 0.0.99.7-1 T207845 |
[production] |
| 14:24 |
<anomie> |
Restarting migrateActors.php on s3 |
[production] |
| 14:19 |
<marostegui> |
Drop empty frimpressions database from m2 - T213973 |
[production] |
| 14:04 |
<vgutierrez> |
running ipvsadm -D -t 10.2.2.29:1968 in lvs1016 - T214041 |
[production] |
| 14:03 |
<vgutierrez> |
running ipvsadm -D -t 10.2.2.29:1968 in lvs1006 - T214041 |
[production] |
| 14:01 |
<gehel> |
pooling maps1004 (first time after stretch upgrade) - T198622 |
[production] |
| 13:46 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=no; selector: dc=.*,service=.*,cluster=kubernetes,name=kubernetes1001.eqiad.wmnet |
[production] |
| 13:38 |
<gehel> |
starting upgrade to stretch for maps1003 - T198622 |
[production] |
| 12:59 |
<addshore> |
swat done! |
[production] |
| 12:58 |
<fsero@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=kubernetes1001.eqiad.wmnet |
[production] |