|
2018-08-14
§
|
| 06:45 |
<_joe_> |
rolling restart of hhvm in eqiad api, high load |
[production] |
| 06:37 |
<_joe_> |
depooling mw1233 from live traffic for debugging |
[production] |
| 05:13 |
<TimStarling> |
killed populateContentTables.php for s2 at jcrespo's request |
[production] |
| 02:45 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Tue Aug 14 02:45:46 UTC 2018 (duration 10m 25s) |
[production] |
| 02:35 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.16) (duration: 13m 57s) |
[production] |
| 00:35 |
<aaron@deploy1001> |
Synchronized wmf-config/mc.php: Enable broadcasted mcrouter cache operations for test wikis and mw.org (duration: 00m 49s) |
[production] |
| 00:15 |
<mutante> |
graphite2002 - stopping carbon-local-relay, running puppet to start it again to confirm no issues with gerrit:448779 |
[production] |
| 00:09 |
<aaron@deploy1001> |
Synchronized wmf-config/mc.php: Only do cache writes to mcrouter for all wikis (duration: 00m 52s) |
[production] |
|
2018-08-13
§
|
| 23:26 |
<urandom> |
Restart Cassandra in RESTBase dev env -- T201863 |
[production] |
| 23:24 |
<godog> |
restart carbon-c-relay on graphite1001 to mirror traffic to graphite1004 - T196484 |
[production] |
| 23:13 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable wp10 and draftquality ORES models on testwiki (T198997) (duration: 00m 51s) |
[production] |
| 22:32 |
<bawolff@deploy1001> |
Synchronized php-1.32.0-wmf.16/resources/src/startup/mediawiki.js: backport I3cd2d7cc295c39 (CSP fixes) (duration: 00m 50s) |
[production] |
| 22:31 |
<Trey314159> |
reindexing Indonesian wikis on elastic@eqiad and elastic@codfw (T200204) |
[production] |
| 22:30 |
<bawolff@deploy1001> |
Synchronized php-1.32.0-wmf.16/includes/OutputPage.php: backport I3cd2d7cc295c39 (CSP fixes) (duration: 00m 50s) |
[production] |
| 22:29 |
<bawolff@deploy1001> |
Synchronized php-1.32.0-wmf.16/includes/ContentSecurityPolicy.php: backport I3cd2d7cc295c39 (CSP fixes) (duration: 00m 51s) |
[production] |
| 22:29 |
<Trey314159> |
reindexing Malay wikis on elastic@eqiad and elastic@codfw complete (T200204) |
[production] |
| 21:30 |
<bawolff@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Deploy adjust CSP settings I74a79dc7defaa (duration: 00m 52s) |
[production] |
| 21:29 |
<mutante> |
elastic1049 - started ferm |
[production] |
| 19:32 |
<Trey314159> |
reindexing Malay wikis on elastic@eqiad and elastic@codfw (T200204) |
[production] |
| 18:47 |
<otto@deploy1001> |
Finished deploy [analytics/refinery@c7f68b7]: camus - Add --check-java-opts and --check-emails-to option - T198908 (duration: 11m 10s) |
[production] |
| 18:35 |
<otto@deploy1001> |
Started deploy [analytics/refinery@c7f68b7]: camus - Add --check-java-opts and --check-emails-to option - T198908 |
[production] |
| 17:16 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@a62b1ac]: new version of wdqs GUI (duration: 10m 54s) |
[production] |
| 17:15 |
<thcipriani@deploy1001> |
Synchronized wmf-config/wikitech.php: [[gerrit:452422|wikitech.php: update keystone URLs]] (duration: 00m 53s) |
[production] |
| 17:05 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@a62b1ac]: new version of wdqs GUI |
[production] |
| 17:02 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@a62b1ac]: new version of wdqs GUI (wdqs1009 only) (duration: 00m 30s) |
[production] |
| 17:01 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@a62b1ac]: new version of wdqs GUI (wdqs1009 only) |
[production] |
| 15:41 |
<otto@deploy1001> |
Finished deploy [analytics/refinery@a051125]: fix for T198908 (duration: 08m 06s) |
[production] |
| 15:33 |
<papaul> |
shutting down lvs2009 to disable on board NICs |
[production] |
| 15:33 |
<otto@deploy1001> |
Started deploy [analytics/refinery@a051125]: fix for T198908 |
[production] |
| 15:10 |
<otto@deploy1001> |
Finished deploy [analytics/refinery@9006a4e]: refinery changes for T198908 (duration: 10m 30s) |
[production] |
| 15:00 |
<otto@deploy1001> |
Started deploy [analytics/refinery@9006a4e]: refinery changes for T198908 |
[production] |
| 14:51 |
<moritzm> |
installing ghostscript security updates |
[production] |
| 14:47 |
<cmjohnson1> |
disabling puppet and shutting down db1052 for final decommissioning |
[production] |
| 14:25 |
<moritzm> |
installing dpkg updates from stretch point release |
[production] |
| 14:10 |
<arturo> |
T201504 disable keystone in main and eqiad1 deployments, all has been downtimed in icinga |
[production] |
| 14:09 |
<andrewbogott> |
stopping nodepool, downtiming horizon for T201504 |
[production] |
| 14:05 |
<moritzm> |
upgrading mw1262-1265 to wikidiff 1.7.2 (T199801) |
[production] |
| 12:56 |
<gehel> |
start reimaging of elasticsearch / cirrus / eqiad cluster (RAID0 / Stretch) - T193649 / T198391 |
[production] |
| 12:56 |
<gehel> |
reimaging of elasticsearch / cirrus / codfw cluster (RAID0 / Stretch) completed - T193649 / T198391 |
[production] |
| 12:53 |
<moritzm> |
upgrading mw1261 servers to wikidiff 1.7.2 (T199801) |
[production] |
| 12:28 |
<moritzm> |
upgrading mwdebug* servers to wikidiff 1.7.2 (T199801) |
[production] |
| 12:28 |
<moritzm> |
upgrading mwdebug* servers to wikidiff 1.7.2 |
[production] |
| 12:24 |
<moritzm> |
uploaded hhvm-wikidiff2 1.7.2 to apt.wikimedia.org (source package name is still php-wikidiff2 for historical reasons) (T199801) |
[production] |
| 12:06 |
<zeljkof> |
EU SWAT finished |
[production] |
| 12:00 |
<moritzm> |
rebooting cloudcontrol* for kernel security update |
[production] |
| 11:58 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:452347|Set mobile wordmark for pswikivoyage (T200152)]] (duration: 00m 52s) |
[production] |
| 11:47 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:452329|Enable Translate extension on oldwikisource (T201814)]] (duration: 00m 50s) |
[production] |
| 11:42 |
<moritzm> |
rebooting dbmonitor* hosts for kernel security update |
[production] |
| 11:29 |
<zfilipin@deploy1001> |
Synchronized static/images/mobile/copyright/: SWAT: [[gerrit:451813|Add missing PNG files in mobile logo folder (T200152)]] (duration: 00m 49s) |
[production] |
| 11:05 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:452343|Bumping portals to master (T128546)]] (duration: 00m 50s) |
[production] |