|
2016-01-22
§
|
| 11:17 |
<bblack> |
codfw LVS under etcd/conftool control now, like ulsfo |
[production] |
| 10:57 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool pc1001 for maintenance (duration: 02m 48s) |
[production] |
| 10:45 |
<_joe_> |
rolling restarting the API cluster in eqiad |
[production] |
| 10:34 |
<_joe_> |
rolling restart of all api appservers in eqiad |
[production] |
| 10:07 |
<_joe_> |
dropping api logs from 2015 on fluorine |
[production] |
| 09:10 |
<_joe_> |
rolling restart of imagescalers in eqiad |
[production] |
| 08:48 |
<_joe_> |
powercycling ms-be1002, blank console, down |
[production] |
| 08:46 |
<_joe_> |
rebooting mw1001 with a new kernel |
[production] |
| 08:07 |
<_joe_> |
upgrading kernel on all mw hosts in eqiad |
[production] |
| 05:07 |
<tstarling@tin> |
Synchronized php-1.27.0-wmf.11/includes/parser/ParserCache.php: (no message) (duration: 01m 28s) |
[production] |
| 02:42 |
<tstarling@tin> |
Synchronized php-1.27.0-wmf.11/includes/parser/ParserCache.php: (no message) (duration: 01m 28s) |
[production] |
| 02:40 |
<tstarling@tin> |
Synchronized php-1.27.0-wmf.11/includes/OutputPage.php: (no message) (duration: 01m 32s) |
[production] |
| 02:30 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.11) (duration: 09m 31s) |
[production] |
| 01:44 |
<catrope@tin> |
Finished scap: Deploying OATHAuth and WikimediaMessages i18n changes (duration: 30m 52s) |
[production] |
| 01:37 |
<gwicke> |
restbase cassandra: increased compression chunk size from 256 to 512k on wikimedia and wikipedia html and data-parsoid |
[production] |
| 01:13 |
<catrope@tin> |
Started scap: Deploying OATHAuth and WikimediaMessages i18n changes |
[production] |
| 00:19 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add ability for OfficeWiki sysops to add and remove flood group rights from themselves. (duration: 01m 27s) |
[production] |
| 00:14 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: enable EventBus extension on mediawikiwiki (duration: 01m 27s) |
[production] |
| 00:10 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: enable sandboxlink on ladwiki and dont sent messages to autocreated accounts on metawiki (duration: 01m 27s) |
[production] |
| 00:08 |
<ebernhardson@tin> |
Synchronized wmf-config/throttle.php: Santiago Editatón throttle rule (duration: 01m 27s) |
[production] |
| 00:02 |
<ebernhardson@tin> |
Synchronized wmf-config/CirrusSearch-production.php: configure cirrus completion suggester recycling (duration: 01m 29s) |
[production] |
| 00:00 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: configure cirrus completion suggester recycling (duration: 01m 28s) |
[production] |
|
2016-01-21
§
|
| 22:46 |
<legoktm> |
started running migratePass0.php (CentralAuth) on group1 wikis |
[production] |
| 22:24 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.27.0-wmf.11 |
[production] |
| 22:23 |
<legoktm> |
started running migratePass0.php (CentralAuth) on group0 wikis |
[production] |
| 21:13 |
<andrewbogott> |
all reachable labs instances are now running security-patched kernels. |
[production] |
| 21:12 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: cswiktionary to 1.27.0-wmf.11 |
[production] |
| 21:12 |
<andrewbogott> |
all labvirt10xx hosts are now running the latest utopic kernel |
[production] |
| 21:08 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.11/includes/session/SessionManager.php: SessionManager: Notify AuthPlugin when auto-creating accounts [[gerrit:265578]] (duration: 01m 26s) |
[production] |
| 21:01 |
<andrewbogott> |
rebooting labvirt1010 |
[production] |
| 20:51 |
<andrewbogott> |
rebooting labvirt1009 |
[production] |
| 20:33 |
<andrewbogott> |
rebooting labvirt1007 |
[production] |
| 20:33 |
<dduvall@tin> |
Synchronized php-1.27.0-wmf.11/includes/user/BotPassword.php: deploy fix for T124335 (duration: 01m 29s) |
[production] |
| 20:27 |
<mobrovac> |
restbase deploy end of 79a4d27 |
[production] |
| 20:20 |
<mobrovac> |
restbase deploy start of 79a4d27 |
[production] |
| 20:16 |
<andrewbogott> |
rebooting labvirt1006 |
[production] |
| 19:54 |
<dduvall@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: rollback cswiktionary to 1.27.0-wmf.10 |
[production] |
| 19:54 |
<andrewbogott> |
rebooting labvirt1005 |
[production] |
| 19:31 |
<andrewbogott> |
rebooting labvirt1004 |
[production] |
| 19:31 |
<dduvall@tin> |
Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes/session/CentralAuthTokenSessionProvider.php: deploy https://gerrit.wikimedia.org/r/#/c/265545/ for 1.27.0-wmf.11 (duration: 01m 28s) |
[production] |
| 19:24 |
<mobrovac> |
restbase rolling-restart after firejail inclusion |
[production] |
| 19:22 |
<mobrovac> |
restbase re-enabling puppet in prod |
[production] |
| 19:13 |
<andrewbogott> |
rebooting labvirt1003 |
[production] |
| 18:57 |
<dduvall@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.27.0-wmf.11 |
[production] |
| 18:53 |
<marxarelli> |
starting train promotion of group1 to 1.27.0-wmf.11 |
[production] |
| 18:52 |
<marxarelli> |
sync to mw2020 failed due to failed host key verification, mw2087/mw2039/mw2098 due to connection failed |
[production] |
| 18:51 |
<marxarelli> |
starting train promotion of group1 to 1.27.0-wmf.11 |
[production] |
| 18:49 |
<marxarelli> |
sync to mw2020 failed due to failed host key verification, mw2087/mw2039/mw2098 due to connection failed |
[production] |
| 18:47 |
<marxarelli> |
4 apache sync failures during sync-file, appear to be know issues |
[production] |
| 18:46 |
<andrewbogott> |
rebooting labvirt1002 |
[production] |