|
2016-05-17
§
|
| 12:21 |
<gehel> |
starting rolling restart of Elasticsearch equiad fro Java update (T135499) |
[production] |
| 12:16 |
<mobrovac> |
mathoid deployed 10c7cb8 |
[production] |
| 11:04 |
<elukey> |
updated facts on puppet compiler following https://wikitech.wikimedia.org/wiki/Nova_Resource:Puppet3-diffs |
[production] |
| 10:59 |
<jynus> |
disabling puppet and starting decom process of db1027 |
[production] |
| 10:30 |
<jynus> |
running schema change on s1 T130692 |
[production] |
| 09:59 |
<filippo@palladium> |
conftool action : set/pooled=yes; selector: mw2050.codfw.wmnet |
[production] |
| 09:14 |
<ema> |
upgrading ulsfo cache_misc to varnish 4 (T131501, T134989) |
[production] |
| 09:02 |
<ema> |
upgrading esams cache_misc to varnish 4 (T126206, T134989) |
[production] |
| 08:54 |
<jynus> |
increased pool stall limit to 500 on db1049 |
[production] |
| 08:53 |
<filippo@palladium> |
conftool action : set/pooled=no; selector: mw2050.codfw.wmnet |
[production] |
| 08:31 |
<ema> |
upgrading codfw cache_misc to varnish 4 (T126206, T134989) |
[production] |
| 08:15 |
<jynus> |
reducing durability and enabling GTID on db1026 T135100 |
[production] |
| 08:14 |
<jynus> |
reducing durability and enabling GTID on db1026 |
[production] |
| 08:13 |
<ema> |
upgrading eqiad cache_misc to varnish 4 (T126206, T134989) |
[production] |
| 08:11 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Set db1026 back as rc node; move roles around (duration: 00m 31s) |
[production] |
| 07:08 |
<_joe_> |
restarted hhvm on mw1255, stuck in a deadlock on HPHP::Treadmill::getAgeOldestRequest |
[production] |
| 07:02 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Reduce db1026 load (duration: 00m 37s) |
[production] |
| 03:44 |
<ori> |
Upgraded Grafana from 3.0.0-pre1 to 3.0.2 |
[production] |
| 02:37 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue May 17 02:37:35 UTC 2016 (duration 8m 46s) |
[production] |
| 02:28 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.1) (duration: 10m 33s) |
[production] |
| 01:13 |
<krenair@tin> |
Synchronized docroot/noc: https://gerrit.wikimedia.org/r/#/c/289118/ (duration: 00m 27s) |
[production] |
| 00:54 |
<YuviPanda> |
restarted rabbitmq on labcontrol1001 |
[production] |
| 00:52 |
<YuviPanda> |
restarted nova-scheduler, let's see if this fixes nodepool |
[production] |
| 00:52 |
<YuviPanda> |
restarted nova-conductor a few mins ago, no help for nodepool |
[production] |
| 00:08 |
<ebernhardson@tin> |
Finished scap: Full scap to sync out WikimediaMessages update (duration: 25m 31s) |
[production] |
| 00:04 |
<mutante> |
created planet2001 ganeti VM on ganeti2001 |
[production] |
| 00:03 |
<mutante> |
mw1230, restart hhvm |
[production] |
|
2016-05-16
§
|
| 23:42 |
<ebernhardson@tin> |
Started scap: Full scap to sync out WikimediaMessages update |
[production] |
| 23:38 |
<ebernhardson@tin> |
scap sync-l10n completed (1.28.0-wmf.1) (duration: 00m 34s) |
[production] |
| 23:37 |
<ebernhardson@tin> |
Synchronized php-1.28.0-wmf.1/extensions/WikimediaMessages/WikimediaMessages.php: re-add interwiki search result messages (duration: 00m 25s) |
[production] |
| 23:26 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.1/extensions/Echo/includes/EmailFormatter.php: Fix unsubstituted message in emails (duration: 00m 25s) |
[production] |
| 23:18 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.1/extensions/WikimediaEvents: SWAT (duration: 00m 26s) |
[production] |
| 23:17 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.1/extensions/UploadWizard: SWAT (duration: 00m 28s) |
[production] |
| 23:13 |
<catrope@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT (duration: 00m 25s) |
[production] |
| 23:13 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT (duration: 00m 25s) |
[production] |
| 23:09 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT (duration: 00m 36s) |
[production] |
| 23:08 |
<catrope@tin> |
Synchronized wmf-config/CirrusSearch-common.php: SWAT (duration: 00m 25s) |
[production] |
| 17:06 |
<ejegg> |
updated payments from 1af7208b4c7387a701f9ce83e33483d1e19213cb to 0b2d6807f68e7ccfc36a431e90d563b4d5a9e966 |
[production] |
| 17:00 |
<godog> |
bounce cassandra-b on restbase2008-b to restart bootstrap |
[production] |
| 16:59 |
<ottomata> |
restarting kafka broker on kafka1022 |
[production] |
| 16:54 |
<ottomata> |
restarted kafka broker on kafka1020 (about 5 mins ago) |
[production] |
| 16:36 |
<ottomata> |
restarting kafka broker on kafka1018 |
[production] |
| 16:23 |
<ottomata> |
restarting kafka broker on kafka1014 |
[production] |
| 16:15 |
<ottomata> |
restarting broker on kafka1013 |
[production] |
| 15:42 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add an alias "ΒΠ" for Project namespace in elwiki [[gerrit:288965]] (duration: 00m 26s) |
[production] |
| 15:36 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: Enable MathML rendering by default on test, wikidata and dewikibooks PART II [[gerrit:286180]] (duration: 00m 24s) |
[production] |
| 15:35 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable MathML rendering by default on test, wikidata and dewikibooks PART I [[gerrit:286180]] (duration: 00m 26s) |
[production] |
| 15:31 |
<bblack> |
starting slow cache_upload frontend restarts (wipes) for cache size upgrades (~10H process) |
[production] |
| 15:29 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add "deletedtext" right to "eliminator" user group on fawiki [[gerrit:288956]] (duration: 00m 26s) |
[production] |
| 15:25 |
<thcipriani@tin> |
Synchronized wmf-config/abusefilter.php: SWAT: Enable blocking feature of AbuseFilter on ptwiktionary [[gerrit:288810]] (duration: 00m 24s) |
[production] |