|
2018-02-23
§
|
| 09:54 |
<elukey> |
restart hhvm on mw1286 |
[production] |
| 09:50 |
<elukey> |
restart hhvm on mw1227 |
[production] |
| 08:05 |
<marostegui> |
MariaDB and kernel upgrade on db1083 |
[production] |
| 07:58 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1083, fully repool db1089 - T162807 (duration: 01m 12s) |
[production] |
| 06:55 |
<marostegui> |
Reboot db2093 to test /srv auto-mounting |
[production] |
| 06:40 |
<marostegui> |
Deploy schema change on db1090 - T187089 T185128 T153182 |
[production] |
| 06:38 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1090 for alter table (duration: 01m 13s) |
[production] |
| 05:58 |
<mutante> |
puppetmaster1001 - signing puppet certs for kafkamon1001/kafkamon2001 - initial puppet runs, adding as role spare (T187901) |
[production] |
| 05:40 |
<mutante> |
ganeti1004 - initial startup of kafkamon1001 - booting to PXE, installing stretch (T187901) |
[production] |
| 04:56 |
<mutante> |
ganeti: ganeti2004 - creating new VM kafkamon2001 - vcpus=2,memory=8g,disk=60G, row_A codfw (T187901) |
[production] |
| 04:53 |
<mutante> |
ganeti: creating new VM kafkamon1001 - vcpus=2,memory=8g,disk=60G, row_A eqiad (T187901) |
[production] |
| 02:46 |
<demon@tin> |
Finished deploy [gerrit/gerrit@23ebf75]: deploying webhooks plugin (duration: 00m 10s) |
[production] |
| 02:46 |
<demon@tin> |
Started deploy [gerrit/gerrit@23ebf75]: deploying webhooks plugin |
[production] |
| 02:10 |
<demon@tin> |
Synchronized docroot/: mw.org docroot moving (duration: 01m 13s) |
[production] |
| 01:45 |
<eileen> |
update process control process-control config revision is 1605238b2e |
[production] |
| 01:20 |
<eileen> |
update civicrm revision changed from aa251f1a93 to a47eafcbad, config revision is c1787646bc |
[production] |
| 01:19 |
<demon@tin> |
Synchronized static/favicon/: smaller favicons (duration: 01m 12s) |
[production] |
| 01:13 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: point mkwikt favicon to en version, dupe (duration: 01m 15s) |
[production] |
| 01:08 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: rtl wikibooks logo (duration: 01m 13s) |
[production] |
| 01:06 |
<demon@tin> |
Synchronized static/favicon/wikibooks-rtl.ico: rtl wikibooks logo (duration: 01m 12s) |
[production] |
| 00:52 |
<demon@tin> |
Synchronized static/images/project-logos/: new project logos for urdu wikt (duration: 01m 13s) |
[production] |
| 00:37 |
<krinkle@tin> |
Synchronized docroot/m.wikipedia.org/w/mobilelanding.php: Ia54cd736f30808 - rm use of MW_LANG (duration: 01m 13s) |
[production] |
|
2018-02-22
§
|
| 22:33 |
<demon@tin> |
Synchronized php-1.31.0-wmf.22/includes/filerepo/file/LocalFile.php: Id5cdd8ec (duration: 01m 12s) |
[production] |
| 22:32 |
<demon@tin> |
Synchronized php-1.31.0-wmf.22/includes/externalstore/: Id5cdd8ec (duration: 01m 12s) |
[production] |
| 22:30 |
<demon@tin> |
Synchronized php-1.31.0-wmf.22/includes/Storage/: Id5cdd8ec (duration: 01m 13s) |
[production] |
| 22:16 |
<maxsem@tin> |
Synchronized php-1.31.0-wmf.21/extensions/SyntaxHighlight_GeSHi/: T188019 (duration: 01m 12s) |
[production] |
| 22:14 |
<maxsem@tin> |
Synchronized php-1.31.0-wmf.22/extensions/SyntaxHighlight_GeSHi/: T188019 (duration: 01m 14s) |
[production] |
| 21:51 |
<demon@tin> |
Synchronized php-1.31.0-wmf.22/includes/externalstore/: I9334d36e (duration: 01m 15s) |
[production] |
| 21:37 |
<dzahn@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=wdqs1004.eqiad.wmnet |
[production] |
| 21:11 |
<gehel> |
powercycling wdqs1004 (complete loss of network) |
[production] |
| 20:39 |
<demon@tin> |
Synchronized php-1.31.0-wmf.22/includes/libs/objectcache/WANObjectCache.php: betterer logging for cache ttl reduction, Iea029e78 (duration: 01m 13s) |
[production] |
| 19:33 |
<XioNoX> |
redirecting Facebook bots large source of traffic to codfw ( https://gerrit.wikimedia.org/r/#/c/413446/ ) |
[production] |
| 19:14 |
<akosiaris> |
rolling restart of eqiad appservers. sudo cumin -b3 -s 30 'A:mw-eqiad' 'restart-hhvm' T188019 |
[production] |
| 19:12 |
<twentyafterfour@tin> |
Synchronized php-1.31.0-wmf.22/extensions/SyntaxHighlight_GeSHi: deploy https://gerrit.wikimedia.org/r/#/c/413437/ (duration: 01m 13s) |
[production] |
| 19:09 |
<twentyafterfour@tin> |
Synchronized php-1.31.0-wmf.21/extensions/SyntaxHighlight_GeSHi: deploy https://gerrit.wikimedia.org/r/#/c/413437/ (duration: 01m 13s) |
[production] |
| 19:09 |
<twentyafterfour> |
syncing https://gerrit.wikimedia.org/r/#/c/413437/ |
[production] |
| 19:03 |
<chasemp> |
baham:~# authdns-update |
[production] |
| 19:00 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2073 (duration: 01m 12s) |
[production] |
| 17:23 |
<elukey> |
installed linux-perf-4.9 on phab1001 to experiment with perf tracing |
[production] |
| 17:20 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1076 (duration: 01m 12s) |
[production] |
| 17:05 |
<XioNoX> |
rolling back "redirecting ns2 traffic to radon" |
[production] |
| 17:02 |
<ema> |
reboot eeden with new kernel 4.9.0-0.bpo.6 |
[production] |
| 16:58 |
<XioNoX> |
redirecting ns2 traffic to radon |
[production] |
| 16:49 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1076 (duration: 01m 12s) |
[production] |
| 16:28 |
<ejegg> |
updated CiviCRM from b27e6a5019 to aa251f1a93 |
[production] |
| 16:26 |
<mobrovac@tin> |
Synchronized wmf-config/jobqueue.php: Use EventBus for refreshLinks in test wikis, file 2/2 - T185052 (duration: 01m 12s) |
[production] |
| 16:25 |
<mobrovac@tin> |
Synchronized wmf-config/InitialiseSettings.php: Use EventBus for refreshLinks in test wikis, file 1/2 - T185052 (duration: 01m 12s) |
[production] |
| 16:23 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@ab3d002]: Enable refreshLinks for group0 wikis T185052 (duration: 00m 36s) |
[production] |
| 16:23 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@ab3d002]: Enable refreshLinks for group0 wikis T185052 |
[production] |
| 16:22 |
<mobrovac@tin> |
scap failed: average error rate on 8/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) |
[production] |