|
2017-04-27
§
|
| 07:16 |
<marostegui@naos> |
Synchronized wmf-config/db-eqiad.php: Repool hosts that needed to be moved for the network maintenance - T162681 (duration: 02m 32s) |
[production] |
| 06:53 |
<marostegui> |
Reboot es1014 for kernel upgrade - T162029 |
[production] |
| 06:50 |
<elukey> |
executed kafka preferred-replica-election to rebalance topic leaders in the analytics cluster after maintenance |
[production] |
| 06:45 |
<marostegui> |
Reboot es1011 for kernel upgrade - T162029 |
[production] |
| 06:39 |
<marostegui> |
Logging for the record: drop table hashs from s2, s3 and s7 (only places where it existed) - T54927 |
[production] |
| 06:23 |
<_joe_> |
moving orphaned objects in ms-be1039's root partition in sdc1/stale_root to save space |
[production] |
| 06:17 |
<marostegui> |
Deploy schema change on s7 metawiki.pagelinks to remove partitioning on db1041 - T153300 |
[production] |
| 06:14 |
<marostegui> |
Deploy alter table on s5 (wikidatawiki) on db1049 - T163548 |
[production] |
| 06:14 |
<marostegui> |
Deploy alter table on s5 (wikidatawiki) on db1070 (running locally instead of neodymium as this host will be affected by the network maintenance) - T163548 |
[production] |
| 06:11 |
<marostegui> |
Deploy alter table on s5 (wikidatawiki) on db1070 (running locally instead of neodymium as this host will be affected by the network maintenance) - T130067 T162539 |
[production] |
| 06:08 |
<marostegui> |
Deploy alter table on s5 (wikidatawiki) on db1049 - T130067 T162539 |
[production] |
| 05:59 |
<marostegui> |
Deploy alter table labsdb1003 (wikidatawiki) https://phabricator.wikimedia.org/T162539%C2%A0https://phabricator.wikimedia.org/T163548 |
[production] |
| 05:24 |
<Amir1> |
cleaning some rows in ores_classification in enwiki (T159753) |
[production] |
| 03:44 |
<ottomata> |
starting kafka broker on kafka1020 |
[production] |
| 03:40 |
<ottomata> |
running kafka replica election to bring kafka1018 back as preferred leader |
[production] |
| 02:21 |
<Jamesofur> |
running populateEditCount.php in screen on wast for T163854, counting edits for board vote eligibility |
[production] |
| 02:16 |
<RoanKattouw> |
Reset 2FA for T163931 on labswiki |
[production] |
| 00:14 |
<twentyafterfour> |
starting phabricator update |
[production] |
| 00:05 |
<ebernhardson@naos> |
Synchronized php-1.29.0-wmf.21/extensions/CirrusSearch/includes/Searcher.php: cirrus: align sister search boost template config variable with documentation (duration: 00m 50s) |
[production] |
|
2017-04-26
§
|
| 23:51 |
<niharika29@naos> |
Synchronized php-1.29.0-wmf.21/includes/interwiki/ClassicInterwikiLookup.php: Interwiki: Dont override interwiki map order (T145337) (duration: 01m 00s) |
[production] |
| 23:38 |
<niharika29@naos> |
Synchronized php-1.29.0-wmf.21/extensions/CirrusSearch/: Align other index template boosting config names (duration: 00m 57s) |
[production] |
| 23:34 |
<niharika29@naos> |
Synchronized wmf-config/InitialiseSettings.php: Increase max field count for wikidata; Enable Flow beta feature on arwiki (T155720) (duration: 00m 58s) |
[production] |
| 23:31 |
<niharika29@naos> |
Synchronized wmf-config/InitialiseSettings.php: Increase max field count for wikidata; Enable Flow beta feature on arwiki (T155720) (duration: 01m 04s) |
[production] |
| 23:29 |
<niharika29@naos> |
Synchronized wmf-config/CirrusSearch-common.php: [cirrus] Increase max field count for wikidata (duration: 01m 23s) |
[production] |
| 21:42 |
<mutante> |
running puppet on all cache::misc nodes via cumin to switch ORES to eqiad |
[production] |
| 21:30 |
<mutante> |
restarting uwsgi-ores service on all scb2* with systemctl restart |
[production] |
| 21:15 |
<twentyafterfour> |
finished with mediawiki deployment train for group1. Everything appears stable, no increase in logspam. |
[production] |
| 21:12 |
<twentyafterfour@naos> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.21 |
[production] |
| 21:09 |
<halfak@naos> |
Started restart [ores/deploy@cc12103]: (no justification provided) |
[production] |
| 21:07 |
<twentyafterfour@naos> |
Synchronized php-1.29.0-wmf.21/extensions/Flow/Hooks.php: sync https://gerrit.wikimedia.org/r/#/c/350481/ refs T163896 T161733 (duration: 01m 20s) |
[production] |
| 21:05 |
<arlolra> |
Updated Parsoid to 4949857a (T116508, T64270, T133673) |
[production] |
| 20:55 |
<arlolra@naos> |
Finished deploy [parsoid/deploy@8d109eb]: Updating Parsoid to 4949857a (duration: 06m 52s) |
[production] |
| 20:48 |
<arlolra@naos> |
Started deploy [parsoid/deploy@8d109eb]: Updating Parsoid to 4949857a |
[production] |
| 20:48 |
<twentyafterfour> |
deploying https://gerrit.wikimedia.org/r/#/c/350481/1 to get the train back on track refs T161733 |
[production] |
| 20:35 |
<bsitzmann@naos> |
Finished deploy [mobileapps/deploy@b5afcb8]: Update mobileapps to 14bd4a5 (duration: 15m 17s) |
[production] |
| 20:34 |
<halfak@naos> |
Finished deploy [ores/deploy@cc12103]: T162892 (duration: 21m 28s) |
[production] |
| 20:31 |
<elukey> |
restart zookeeper on conf1003 after network maintenance |
[production] |
| 20:20 |
<bsitzmann@naos> |
Started deploy [mobileapps/deploy@b5afcb8]: Update mobileapps to 14bd4a5 |
[production] |
| 20:12 |
<halfak@naos> |
Started deploy [ores/deploy@cc12103]: T162892 |
[production] |
| 19:50 |
<elukey> |
restart kafka nodes (kafka1018 and kafka1020) after network maintenance |
[production] |
| 19:45 |
<twentyafterfour@naos> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.20 |
[production] |
| 19:42 |
<twentyafterfour> |
rolling back group1 to wmf.20 due to T163896 refs T161733 |
[production] |
| 19:31 |
<twentyafterfour@naos> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.21 |
[production] |
| 19:24 |
<twentyafterfour> |
begin deployment train: group1 wikis to 1.29.0-wmf.21 refs T161733 |
[production] |
| 19:22 |
<bblack> |
initiating cumin-based restart of all varnish backends for cache_upload in codfw to downgrade from experimental package. 30 minute spacing, 10 hosts, ~5h to completion... |
[production] |
| 19:17 |
<thcipriani@naos> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:350442|Disable collectionsaveascommunitypage right on es.wikipedia]] T163767 (duration: 00m 49s) |
[production] |
| 19:05 |
<bblack> |
restarting varnish frontend and backend on cp3033 to downgrade |
[production] |
| 19:03 |
<bblack> |
restaring varnish-frontend on cp2014 to downgrade |
[production] |
| 18:58 |
<thcipriani@naos> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:350459|Workaround issue of overriding whitelist config variable]] T163114 (duration: 00m 53s) |
[production] |
| 18:56 |
<bblack> |
downgrading varnish back to 4.1.5-wm1 on all -wm2 hosts |
[production] |