|
2015-05-18
§
|
| 19:35 |
<ori> |
restarted statsv on hafnium |
[production] |
| 18:29 |
<ori> |
Synchronized php-1.26wmf6/includes: 335f8a257d, e3b2255d9c (for UBN! T99468) (duration: 00m 28s) |
[production] |
| 18:28 |
<ori> |
Synchronized php-1.26wmf5/includes: 335f8a257d, e3b2255d9c (for UBN! T99468) (duration: 01m 26s) |
[production] |
| 18:06 |
<ori> |
restarted HHVM on mw1107 with libjemalloc heap profiling enabled |
[production] |
| 17:55 |
<ori> |
Enabling heap profiling on mw11107 to troubleshoot T99525 |
[production] |
| 17:08 |
<andrewbogott> |
starting all instances on labvirt1001 (well, the ones that were running before) |
[production] |
| 16:59 |
<andrewbogott_> |
dist-upgrading labvirt1001 since it’s down anyway and we may be due for kernel updates. |
[production] |
| 16:53 |
<andrewbogott_> |
rebooting labvirt1001, and frowning a lot |
[production] |
| 15:59 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/209286/ and https://gerrit.wikimedia.org/r/#/c/211407/ - should be no-ops (duration: 00m 20s) |
[production] |
| 15:36 |
<marktraceur> |
Synchronized php-1.26wmf6/includes/: [SWAT] [wmf6] resourceloader: Don't cache minification of user.tokens (duration: 00m 19s) |
[production] |
| 15:24 |
<marktraceur> |
Synchronized php-1.26wmf6/includes/Title.php: [SWAT] [wmf6] Log callers that trigger Title::newFromText $text type warning (duration: 00m 46s) |
[production] |
| 15:23 |
<marktraceur> |
Synchronized php-1.26wmf5/includes/Title.php: [SWAT] [wmf5] Log callers that trigger Title::newFromText $text type warning (duration: 00m 15s) |
[production] |
| 15:07 |
<marktraceur> |
Synchronized wmf-config/InitialiseSettings.php: [SWAT] [config] Add wikis for deployment on 2015-05-18 (duration: 00m 29s) |
[production] |
| 14:35 |
<andrewbogott> |
disabling puppet on labnet1001 to debug dnsmasq |
[production] |
| 14:07 |
<_joe_> |
restarting HHVM on mw1107 - memory leak probably happening |
[production] |
| 13:38 |
<aude> |
Synchronized wmf-config/InitialiseSettings-labs.php: Remove beta-specific Graph settings (duration: 01m 46s) |
[production] |
| 13:34 |
<aude> |
Synchronized wmf-config/InitialiseSettings.php: Enable arbitrary access on enwikivoyage, fawiki, and hewiki, and graph extension everywhere (duration: 00m 57s) |
[production] |
| 13:31 |
<aude> |
Synchronized php-1.26wmf6/extensions/Wikidata: Fix rdf dump script (duration: 03m 23s) |
[production] |
| 13:27 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1063 after warmup period (duration: 01m 01s) |
[production] |
| 13:01 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1063 (duration: 00m 17s) |
[production] |
| 11:13 |
<yurik> |
deployed graphoid update to fix https://phabricator.wikimedia.org/T99349 |
[production] |
| 11:10 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: depool db1063 (duration: 01m 00s) |
[production] |
| 11:07 |
<jynus> |
depooling db1063 from cluster for maintenance |
[production] |
| 09:02 |
<godog> |
loss on ulsfo-eqiad, depooled ulsfo |
[production] |
| 05:18 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon May 18 05:17:50 UTC 2015 (duration 17m 49s) |
[production] |
| 02:46 |
<LocalisationUpdate> |
completed (1.26wmf6) at 2015-05-18 02:45:52+00:00 |
[production] |
| 02:42 |
<l10nupdate> |
Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 05m 35s) |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.26wmf5) at 2015-05-18 02:25:54+00:00 |
[production] |
| 02:21 |
<l10nupdate> |
Synchronized php-1.26wmf5/cache/l10n: (no message) (duration: 06m 24s) |
[production] |
|
2015-05-16
§
|
| 13:27 |
<manybubbles> |
that was the last server in the elasticsearch rolling restart. all done. now we have new versions of the plugins. Lets try not to do that again. |
[production] |
| 13:25 |
<manybubbles> |
es-tool restart-fast on elastic1031 |
[production] |
| 09:15 |
<godog> |
bounce hhvm on mw1196 |
[production] |
| 09:10 |
<godog> |
bounce hhvm on mw1141 |
[production] |
| 07:49 |
<godog> |
restart hhvm on mw1234, still pushing xhprof metrics |
[production] |
| 06:03 |
<_joe_> |
killed nrpe on labvirt1003 - see T99341 |
[production] |
| 05:02 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat May 16 05:01:02 UTC 2015 (duration 1m 1s) |
[production] |
| 04:11 |
<andrewbogott> |
restarting sshd and generally poking around on labvirt1003 |
[production] |
| 02:47 |
<LocalisationUpdate> |
completed (1.26wmf6) at 2015-05-16 02:46:08+00:00 |
[production] |
| 02:43 |
<l10nupdate> |
Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 04m 55s) |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.26wmf5) at 2015-05-16 02:28:37+00:00 |
[production] |
| 02:25 |
<l10nupdate> |
Synchronized php-1.26wmf5/cache/l10n: (no message) (duration: 05m 55s) |
[production] |