|
2018-05-03
§
|
| 12:26 |
<moritzm> |
installing openjdk-8 security updates on stretch-based Hadoop workers |
[production] |
| 11:57 |
<moritzm> |
reimaging mw1301, mw1302 (job runners) to stretch |
[production] |
| 10:51 |
<moritzm> |
reimaging mw1319, mw1325, mw1326 (app servers) to stretch |
[production] |
| 09:29 |
<moritzm> |
reimaging mw1227, mw1231, mw1232 (API servers) to stretch |
[production] |
| 09:09 |
<gehel> |
rolling restart of elasticsearch completed - T191543 / T191236 |
[production] |
| 09:06 |
<moritzm> |
reimaging mw1300 (job runner) to stretch |
[production] |
| 08:33 |
<moritzm> |
installing Java security updates on wdqs* |
[production] |
| 08:30 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.2/extensions/WikimediaEvents/WikimediaEventsHooks.php: T191500 [[gerrit:430380|Update campaign prefix for onBeforeInitializeWMDECampaign hook]] (duration: 01m 16s) |
[production] |
| 08:29 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.1/extensions/WikimediaEvents/WikimediaEventsHooks.php: T191500 [[gerrit:430379|Update campaign prefix for onBeforeInitializeWMDECampaign hook]] (duration: 01m 17s) |
[production] |
| 08:27 |
<mobrovac@tin> |
Finished deploy [changeprop/deploy@7e86531]: Bug fix: Resubscribe to the proper list of topics on metadata change (duration: 01m 12s) |
[production] |
| 08:26 |
<mobrovac@tin> |
Started deploy [changeprop/deploy@7e86531]: Bug fix: Resubscribe to the proper list of topics on metadata change |
[production] |
| 08:18 |
<mobrovac@tin> |
Finished deploy [cpjobqueue/deploy@5c1dcb9]: Bug fix: Resubscribe to the proper list of topics on metadata change (duration: 00m 54s) |
[production] |
| 08:17 |
<mobrovac@tin> |
Started deploy [cpjobqueue/deploy@5c1dcb9]: Bug fix: Resubscribe to the proper list of topics on metadata change |
[production] |
| 08:13 |
<ema> |
cp-misc: upgrade varnish to 5.1.3-1wm8 T192368 |
[production] |
| 08:08 |
<godog> |
eqiad-prod: more weight to ms-be104[0-3] - T190081 |
[production] |
| 07:54 |
<moritzm> |
reimaging mw1284, mw1289, mw1290 (API servers) to stretch |
[production] |
| 07:39 |
<moritzm> |
reimaging mw1256, mw1257, mw1258 (app servers) to stretch |
[production] |
| 07:26 |
<marostegui> |
Drop table flaggedrevs from eswikibooks - T193676 |
[production] |
| 07:11 |
<moritzm> |
reimaging mwdebug1002 to stretch |
[production] |
| 05:59 |
<marostegui> |
Drop mostly empty flagged* tables from metawiki (s7) - T193390 |
[production] |
| 05:59 |
<marostegui> |
Drop mostly empty flagged* tables from metawiki (s7) - T193678 |
[production] |
| 05:57 |
<elukey> |
reimage analytics10[39,40] to Debian Stretch |
[production] |
| 05:31 |
<marostegui> |
Drop empty flagged* tables from eswiki (s7) - T193678 |
[production] |
| 05:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Clarify that db1060 is running an alter table (duration: 01m 15s) |
[production] |
| 05:22 |
<marostegui> |
Deploy schema change on db1060 with replication (this will generate lag on labs - s2) - T191519 T188299 T190148 |
[production] |
| 03:32 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2182.codfw.wmnet |
[production] |
| 03:28 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2181.codfw.wmnet |
[production] |
| 03:26 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2180.codfw.wmnet |
[production] |
| 02:43 |
<l10nupdate@tin> |
scap sync-l10n completed (1.32.0-wmf.1) (duration: 07m 20s) |
[production] |
| 00:33 |
<krinkle@tin> |
Synchronized php-1.32.0-wmf.1/extensions/NavigationTiming/modules/: Ie77e77de3b8 (duration: 01m 18s) |
[production] |
| 00:20 |
<mutante> |
mw2180,mw2181,mw2182 - reinstalling with stretch (in case there are alerts that's why) |
[production] |
| 00:02 |
<twentyafterfour> |
no phabricator upgrade tonight. |
[production] |
|
2018-05-02
§
|
| 23:39 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2179.codfw.wmnet |
[production] |
| 23:35 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2178.codfw.wmnet |
[production] |
| 23:29 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2177.codfw.wmnet |
[production] |
| 23:17 |
<catrope@tin> |
Synchronized php-1.32.0-wmf.2/extensions/Kartographer/: Add maintenance script to purge pages with map tags (T193525) (duration: 01m 18s) |
[production] |
| 22:24 |
<XioNoX> |
Re-enabled the link between fasw-eqiad and pfw3b-eqiad (backup) - T192104 |
[production] |
| 22:18 |
<ebernhardson> |
start reindex of viwiki on eqiad elasticsearch, failed on last run due to unrelated issues |
[production] |
| 22:17 |
<XioNoX> |
Disabling the link between fasw-eqiad and pfw3b-eqiad (backup) - T192104 |
[production] |
| 22:17 |
<XioNoX> |
Re-enabled the link between fasw-codfw and pfw3b-codfw (backup) - T192104 |
[production] |
| 21:42 |
<XioNoX> |
Disabling the link between fasw-codfw and pfw3b-codfw (backup) - T192104 |
[production] |
| 21:33 |
<XioNoX> |
failing-over RG1 to node0 on pfw3-codfw - T192104 |
[production] |
| 19:54 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2173.codfw.wmnet |
[production] |
| 19:38 |
<mutante> |
mw2173 - scap pull (wasn't pooled but should have, bring up to date) |
[production] |
| 19:25 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: revert group1 to 1.32.0-wmf.2 |
[production] |
| 19:23 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: group1 to 1.32.0-wmf.2 |
[production] |
| 19:18 |
<mutante> |
mw2177, mw2178, mw2179 - reinstalling with stretch |
[production] |
| 19:14 |
<ppchelko@tin> |
Finished deploy [restbase/deploy@1093d1d]: Sample log action api 4xx with 1% probability (duration: 16m 18s) |
[production] |
| 19:10 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2176.codfw.wmnet |
[production] |
| 19:08 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2175.codfw.wmnet |
[production] |