|
2017-06-07
§
|
| 17:14 |
<elukey> |
restart nutcracker on thumbor1002 (too many connections approaching the 1024 ulimit) |
[production] |
| 15:37 |
<akosiaris> |
disable puppet on puppetmaster1001, depool rhodium for tests |
[production] |
| 14:51 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=ms-fe2007.codfw.wmnet |
[production] |
| 14:48 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=ms-fe1007.codfw.wmnet |
[production] |
| 14:11 |
<dcausse> |
eu swat done |
[production] |
| 12:56 |
<aude@tin> |
Synchronized php-1.30.0-wmf.4/extensions/Wikidata: Fix parser function registration T167238 (duration: 02m 20s) |
[production] |
| 12:43 |
<marostegui> |
Drop table updates on s2 - T139342 |
[production] |
| 12:40 |
<aude@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable Wikibase Client on beta wiktionary sites T158323 (duration: 00m 43s) |
[production] |
| 12:40 |
<elukey> |
upgrade zookeeper packages on conf2002 to 3.4.5+dfsg-2+deb8u2 |
[production] |
| 12:32 |
<bblack> |
cp1072, cp1063 restarting varnish backend for mailbox lag |
[production] |
| 12:26 |
<aude@tin> |
Synchronized wmf-config/Wikibase.php: Site links for non-main namespace wiktionary pages T158323 (duration: 00m 43s) |
[production] |
| 12:19 |
<aude@tin> |
Synchronized wmf-config/Wikibase-labs.php: Site links for non-main namespace wiktionary pages (duration: 00m 44s) |
[production] |
| 11:08 |
<gehel> |
restarting cron on logstash cluster |
[production] |
| 10:29 |
<moritzm> |
installing tiff regression security update on trusty |
[production] |
| 10:26 |
<ema> |
upgrade lvs1*/lvs2* to jessie 8.8 point release T164703 |
[production] |
| 09:49 |
<ema> |
upgrade lvs[3001-3004] to jessie 8.8 point release T164703 |
[production] |
| 09:28 |
<gehel> |
upgrading kibana to v5.3.3 on logstash cluster - T167266 |
[production] |
| 09:15 |
<ema> |
upgrade lvs4001-4004 to jessie 8.8 point release T164703 |
[production] |
| 08:58 |
<marostegui> |
Deploy alter table on s2 - db1076 - T166205 |
[production] |
| 08:58 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1076 - T166205 (duration: 00m 43s) |
[production] |
| 08:50 |
<marostegui> |
Deploy alter table s4 - db1056 - T166206 |
[production] |
| 08:34 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1056 - T166206 (duration: 00m 43s) |
[production] |
| 08:02 |
<marostegui> |
Run redact_sanitarium on db1095 for dewiki - T153743 |
[production] |
| 07:22 |
<marostegui> |
Deploy alter table on db1047 enwiki.revision - T162807 |
[production] |
| 06:49 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1056 - T166206 (duration: 00m 44s) |
[production] |
| 05:35 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1053, depool db1056 - T166206 (duration: 01m 03s) |
[production] |
| 03:11 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Jun 7 03:11:40 UTC 2017 (duration 6m 54s) |
[production] |
| 03:04 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.4) (duration: 14m 29s) |
[production] |
| 02:30 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.2) (duration: 07m 57s) |
[production] |
| 00:21 |
<RainbowSprinkles> |
gerrit: rolled back to 2.13.4-13-gc0c5cc4742 from 2.13.8. T152640 rearing its ugly head again (login issues) |
[production] |
|
2017-06-06
§
|
| 23:59 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.2/extensions/Flow/includes/Content/BoardContentHandler.php: SWAT: [[gerrit:357500|Revert "Throw when unserializing invalid Flow workflow metadata JSON"]] T166100 T156813 (duration: 00m 43s) |
[production] |
| 23:58 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.4/extensions/Flow/includes/Content/BoardContentHandler.php: SWAT: [[gerrit:357501|Revert "Throw when unserializing invalid Flow workflow metadata JSON"]] T166100 T156813 (duration: 00m 45s) |
[production] |
| 23:56 |
<RainbowSprinkles> |
gerrit: back from reindexing |
[production] |
| 23:55 |
<RainbowSprinkles> |
gerrit: force stopping for a second to reindex accounts |
[production] |
| 23:17 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:357425|Disable page previews on wikispecies]] T166894 (duration: 00m 44s) |
[production] |
| 23:12 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:357426|Update ContentNamespaces for Commons Wiki]] T167077 (duration: 00m 46s) |
[production] |
| 21:57 |
<RainbowSprinkles> |
gerrit: restarting last time, didn't work like I wanted |
[production] |
| 21:53 |
<RainbowSprinkles> |
gerrit: restarting to test a config tweak |
[production] |
| 21:41 |
<mutante> |
contint1001 - graceful'ed Apache to deploy gerrit:351391 |
[production] |
| 21:19 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: unbreak mw.org pref page |
[production] |
| 20:21 |
<RainbowSprinkles> |
gerrit: Down for just a moment, finally doing point release on cobalt |
[production] |
| 19:57 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.4 |
[production] |
| 19:45 |
<demon@tin> |
Finished scap: testwiki to wmf.4 + prepping l10n. again (x2) (duration: 20m 25s) |
[production] |
| 19:36 |
<mutante> |
cobalt - removed systemd unit file (that has issues with ulimit and isn't used yet) - ran "systemctl reset-failed" which cleared the "systemctl status" which made the Icinga check recover |
[production] |
| 19:24 |
<demon@tin> |
Started scap: testwiki to wmf.4 + prepping l10n. again (x2) |
[production] |
| 19:23 |
<demon@tin> |
scap failed: RuntimeError scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) (duration: 13m 32s) |
[production] |
| 19:23 |
<demon@tin> |
scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) |
[production] |
| 19:10 |
<demon@tin> |
Started scap: testwiki to wmf.4 + prepping l10n. again |
[production] |
| 19:08 |
<demon@tin> |
Synchronized README: No-op, just forcing co-master sync (duration: 01m 27s) |
[production] |
| 19:01 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: testwiki back to wmf.2 |
[production] |