|
2016-02-24
§
|
| 15:07 |
<hasharAW> |
beta app servers have lost access to memcached due to bad nutcracker conf | T127966 |
[production] |
| 14:55 |
<godog> |
nodetool-a repair -pr on restbase1008 T108611 |
[production] |
| 14:46 |
<bblack> |
cache_text: -do_gzip experiment live on all |
[production] |
| 14:43 |
<godog> |
bump max reconstruction speed on restbase2001 to 0 T127951 |
[production] |
| 14:41 |
<hashar> |
beta: we have a lost a memcached server 11:51am UTC |
[production] |
| 14:08 |
<krinkle@tin> |
Synchronized wmf-config/InitialiseSettings.php: T99096: Enable wmfstatic for medium wikis (duration: 01m 40s) |
[production] |
| 13:46 |
<godog> |
bump max reconstruction speed on restbase2001 to 1 T127951 |
[production] |
| 13:15 |
<godog> |
restart cassandra on restbase2001, throttle raid rebuild speed to 8MB/s |
[production] |
| 11:06 |
<godog> |
reboot restbase2001 |
[production] |
| 11:01 |
<godog> |
mdadm errors on restbase2001 while growing the raid0, load increasing |
[production] |
| 10:53 |
<godog> |
grow restbase2001 raid0 to include a 5th disk |
[production] |
| 08:42 |
<moritzm> |
installing libssh2 security updates across the cluster |
[production] |
| 05:46 |
<demon@tin> |
Synchronized docroot/: removing skel-1.5 symlinks (duration: 01m 41s) |
[production] |
| 05:37 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: import meta to wikitechwiki (duration: 01m 45s) |
[production] |
| 05:28 |
<twentyafterfour> |
applied https://secure.phabricator.com/rP03d6e7f1b699d89c829e92ba0da2178b41ad1d6a on iridium to fix visibility on pastes |
[production] |
| 05:11 |
<ori> |
Restarting HHVM on codfw app servers to make sure they pick a file-scope change to stop profiling PyBal health-checks |
[production] |
| 05:04 |
<ori@mira> |
Synchronized wmf-config/StartProfiler.php: I0e7be0b5: Never profile PyBal health-checks (duration: 03m 12s) |
[production] |
| 03:19 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Feb 24 03:19:41 UTC 2016 (duration 8m 46s) |
[production] |
| 03:10 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.14) (duration: 18m 05s) |
[production] |
| 02:40 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add default to fix notices about wmgUseFlow (duration: 01m 36s) |
[production] |
| 02:37 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.13/extensions/Echo: SWAT (duration: 01m 40s) |
[production] |
| 02:35 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.14/extensions/Echo: SWAT (duration: 01m 42s) |
[production] |
| 02:33 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.13) (duration: 13m 47s) |
[production] |
| 01:50 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Use Flow dblists for deciding which wikis have Flow (duration: 01m 38s) |
[production] |
| 01:47 |
<catrope@tin> |
Synchronized wmf-config/CommonSettings.php: Recognize new Flow dblist (duration: 01m 35s) |
[production] |
| 01:38 |
<catrope@tin> |
Synchronized dblists/: Add new dblists for Flow (duration: 01m 32s) |
[production] |
| 01:34 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Use project logos for welcome notifications (duration: 01m 34s) |
[production] |
| 01:32 |
<catrope@tin> |
Synchronized w/static/images: Add project logos for Echo (duration: 01m 33s) |
[production] |
| 01:24 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/272889/ (duration: 01m 35s) |
[production] |
| 01:21 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/272837/ (duration: 01m 35s) |
[production] |
| 01:13 |
<aaron@tin> |
Synchronized wmf-config/filebackend-production.php: Enable async secondary swift writes for non-"big" wikis (duration: 01m 31s) |
[production] |
| 00:40 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.14/extensions/CentralAuth: SessionManager backports (duration: 01m 39s) |
[production] |
| 00:37 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.14/extensions/WikimediaMessages: SessionManager backports (duration: 01m 37s) |
[production] |
| 00:35 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.14/includes: SessionManager backports (duration: 02m 17s) |
[production] |
| 00:00 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.13/includes: Backport MW_NO_SESSION changes (duration: 02m 13s) |
[production] |
|
2016-02-23
§
|
| 23:57 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.13/autoload.php: (no message) (duration: 01m 42s) |
[production] |
| 23:22 |
<krinkle@tin> |
Synchronized w/static.php: (no message) (duration: 01m 35s) |
[production] |
| 23:08 |
<aude@tin> |
Synchronized wmf-config/Wikibase.php: Bump cache epoch for Wikidata for Wikiversity sitelinks section (duration: 01m 32s) |
[production] |
| 22:45 |
<thcipriani> |
deployment-puppetmaster is in a weird rebase state |
[production] |
| 22:36 |
<aude@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add Wikibase settings for Wikiversity (duration: 01m 31s) |
[production] |
| 22:30 |
<aude@tin> |
Synchronized wmf-config/Wikibase.php: Add Wikiversity site link section to Wikidata (duration: 02m 23s) |
[production] |
| 22:25 |
<legoktm> |
running sync-common manually on deployment-mediawiki02 |
[production] |
| 22:23 |
<aude@tin> |
Finished scap: Add Wikidata i18n messages to WikimediaMessages, update Wikibase on wmf14, and some core backports (duration: 51m 45s) |
[production] |
| 21:32 |
<chasemp> |
reboot mw1114 via mgmt as unresponsive |
[production] |
| 21:31 |
<aude@tin> |
Started scap: Add Wikidata i18n messages to WikimediaMessages, update Wikibase on wmf14, and some core backports |
[production] |
| 21:25 |
<ejegg> |
updated SmashPig from e106af8d440b461779cca60d55efba33dbfa7518 to 5ef60d1fb73d70b7b1501bc97273505c2d625159 |
[production] |
| 21:01 |
<ejegg> |
updated SmashPig from d2083b28c28bd6afe61d30fc913fa0edd4203f82 to e106af8d440b461779cca60d55efba33dbfa7518 |
[production] |
| 20:50 |
<urandom> |
initiating `nodetool upgradesstables -a' in staging to rewrite sstables (restored earlier compression settings) |
[production] |
| 20:26 |
<aude@tin> |
Synchronized php-1.27.0-wmf.13/includes/session/CookieSessionProvider.php: Fix invalid key warning (duration: 01m 32s) |
[production] |
| 19:38 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/272799 (duration: 01m 37s) |
[production] |