|
2016-05-17
§
|
| 08:54 |
<jynus> |
increased pool stall limit to 500 on db1049 |
[production] |
| 08:53 |
<filippo@palladium> |
conftool action : set/pooled=no; selector: mw2050.codfw.wmnet |
[production] |
| 08:31 |
<ema> |
upgrading codfw cache_misc to varnish 4 (T126206, T134989) |
[production] |
| 08:15 |
<jynus> |
reducing durability and enabling GTID on db1026 T135100 |
[production] |
| 08:14 |
<jynus> |
reducing durability and enabling GTID on db1026 |
[production] |
| 08:13 |
<ema> |
upgrading eqiad cache_misc to varnish 4 (T126206, T134989) |
[production] |
| 08:11 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Set db1026 back as rc node; move roles around (duration: 00m 31s) |
[production] |
| 07:08 |
<_joe_> |
restarted hhvm on mw1255, stuck in a deadlock on HPHP::Treadmill::getAgeOldestRequest |
[production] |
| 07:02 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Reduce db1026 load (duration: 00m 37s) |
[production] |
| 03:44 |
<ori> |
Upgraded Grafana from 3.0.0-pre1 to 3.0.2 |
[production] |
| 02:37 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue May 17 02:37:35 UTC 2016 (duration 8m 46s) |
[production] |
| 02:28 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.1) (duration: 10m 33s) |
[production] |
| 01:13 |
<krenair@tin> |
Synchronized docroot/noc: https://gerrit.wikimedia.org/r/#/c/289118/ (duration: 00m 27s) |
[production] |
| 00:54 |
<YuviPanda> |
restarted rabbitmq on labcontrol1001 |
[production] |
| 00:52 |
<YuviPanda> |
restarted nova-scheduler, let's see if this fixes nodepool |
[production] |
| 00:52 |
<YuviPanda> |
restarted nova-conductor a few mins ago, no help for nodepool |
[production] |
| 00:08 |
<ebernhardson@tin> |
Finished scap: Full scap to sync out WikimediaMessages update (duration: 25m 31s) |
[production] |
| 00:04 |
<mutante> |
created planet2001 ganeti VM on ganeti2001 |
[production] |
| 00:03 |
<mutante> |
mw1230, restart hhvm |
[production] |
|
2016-05-16
§
|
| 23:42 |
<ebernhardson@tin> |
Started scap: Full scap to sync out WikimediaMessages update |
[production] |
| 23:38 |
<ebernhardson@tin> |
scap sync-l10n completed (1.28.0-wmf.1) (duration: 00m 34s) |
[production] |
| 23:37 |
<ebernhardson@tin> |
Synchronized php-1.28.0-wmf.1/extensions/WikimediaMessages/WikimediaMessages.php: re-add interwiki search result messages (duration: 00m 25s) |
[production] |
| 23:26 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.1/extensions/Echo/includes/EmailFormatter.php: Fix unsubstituted message in emails (duration: 00m 25s) |
[production] |
| 23:18 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.1/extensions/WikimediaEvents: SWAT (duration: 00m 26s) |
[production] |
| 23:17 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.1/extensions/UploadWizard: SWAT (duration: 00m 28s) |
[production] |
| 23:13 |
<catrope@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT (duration: 00m 25s) |
[production] |
| 23:13 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT (duration: 00m 25s) |
[production] |
| 23:09 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT (duration: 00m 36s) |
[production] |
| 23:08 |
<catrope@tin> |
Synchronized wmf-config/CirrusSearch-common.php: SWAT (duration: 00m 25s) |
[production] |
| 17:06 |
<ejegg> |
updated payments from 1af7208b4c7387a701f9ce83e33483d1e19213cb to 0b2d6807f68e7ccfc36a431e90d563b4d5a9e966 |
[production] |
| 17:00 |
<godog> |
bounce cassandra-b on restbase2008-b to restart bootstrap |
[production] |
| 16:59 |
<ottomata> |
restarting kafka broker on kafka1022 |
[production] |
| 16:54 |
<ottomata> |
restarted kafka broker on kafka1020 (about 5 mins ago) |
[production] |
| 16:36 |
<ottomata> |
restarting kafka broker on kafka1018 |
[production] |
| 16:23 |
<ottomata> |
restarting kafka broker on kafka1014 |
[production] |
| 16:15 |
<ottomata> |
restarting broker on kafka1013 |
[production] |
| 15:42 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add an alias "ΒΠ" for Project namespace in elwiki [[gerrit:288965]] (duration: 00m 26s) |
[production] |
| 15:36 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: Enable MathML rendering by default on test, wikidata and dewikibooks PART II [[gerrit:286180]] (duration: 00m 24s) |
[production] |
| 15:35 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable MathML rendering by default on test, wikidata and dewikibooks PART I [[gerrit:286180]] (duration: 00m 26s) |
[production] |
| 15:31 |
<bblack> |
starting slow cache_upload frontend restarts (wipes) for cache size upgrades (~10H process) |
[production] |
| 15:29 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add "deletedtext" right to "eliminator" user group on fawiki [[gerrit:288956]] (duration: 00m 26s) |
[production] |
| 15:25 |
<thcipriani@tin> |
Synchronized wmf-config/abusefilter.php: SWAT: Enable blocking feature of AbuseFilter on ptwiktionary [[gerrit:288810]] (duration: 00m 24s) |
[production] |
| 15:14 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Set meta namespace names for jamwiki [[gerrit:288628]] (duration: 00m 27s) |
[production] |
| 15:09 |
<bblack> |
varnish package upgrade on cache_maps done |
[production] |
| 15:08 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: wgCopyUploadProxy: Vary per datacenter [[gerrit:287095]] (duration: 00m 26s) |
[production] |
| 15:01 |
<hoo@tin> |
Synchronized wmf-config/Wikibase.php: Update Wikidata property blacklist (duration: 00m 25s) |
[production] |
| 14:55 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Remove all mentions to db1027, db2008 and db2009 (duration: 00m 33s) |
[production] |
| 14:54 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Remove all mentions to db1027, db2008 and db2009 (duration: 00m 34s) |
[production] |
| 14:45 |
<mobrovac> |
change-propagation deployed ef5f6ff55 |
[production] |
| 14:45 |
<bblack> |
starting varnish package upgrade on cache_maps |
[production] |