|
2019-08-21
§
|
| 14:29 |
<godog> |
silence average mw appserver latency alerts for 24h, too noisy |
[production] |
| 14:28 |
<elukey> |
swap turnilo backend in varnish from analytics-tool1002 to an-tool1007 |
[production] |
| 14:27 |
<moritzm> |
installing ca-certificates-java update from Stretch point release |
[production] |
| 14:10 |
<marostegui> |
Upgrade mysql on db2075 |
[production] |
| 13:12 |
<zfilipin@deploy1001> |
Synchronized php: group1 wikis to 1.34.0-wmf.19 (duration: 00m 55s) |
[production] |
| 13:11 |
<zfilipin@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.19 |
[production] |
| 11:59 |
<jbond42> |
add ipv6 mapped address to mw codfw servers |
[production] |
| 11:41 |
<Amir1> |
EU SWAT is done |
[production] |
| 11:38 |
<jijiki> |
Restarting ores on ores1004 and ores1005 |
[production] |
| 11:37 |
<elukey> |
restart celery-ores-worker on ores1002 |
[production] |
| 10:57 |
<Urbanecm> |
Run scap pull on mwdebug1002 (T230601) |
[production] |
| 10:52 |
<Urbanecm> |
Move 0a87e3c's code to abusefilter.php on mwdebug1002 (T230601) |
[production] |
| 10:49 |
<Urbanecm> |
Previous log entry was for mwdebug1002 |
[production] |
| 10:49 |
<Urbanecm> |
Wrapped code added to CommonSettings.php in T230601 to wgExtensionFunctions |
[production] |
| 10:45 |
<Urbanecm> |
Run mwscript namespaceDupes.php --wiki=zhwikisource --add-prefix=FIXME --fix (T230548) |
[production] |
| 10:02 |
<moritzm> |
installing puppetdb1002 |
[production] |
| 09:46 |
<tarrow> |
finished enabling termbox on wikidatawiki |
[production] |
| 09:36 |
<tarrow@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:531433|Enable Termbox on wikidatawiki (T230896)]] (duration: 00m 55s) |
[production] |
| 09:29 |
<moritzm> |
rebooting db2102 (reverting to a proper stretch 4.9 kernel, it used a bpo kernel due to some hardware debuging a while back) |
[production] |
| 09:20 |
<@> |
helmfile [EQIAD] Ran 'apply' command on namespace 'termbox' for release 'production' . |
[production] |
| 09:15 |
<@> |
helmfile [CODFW] Ran 'apply' command on namespace 'termbox' for release 'production' . |
[production] |
| 09:09 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:09 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:09 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'staging' . |
[production] |
| 09:07 |
<_joe_> |
uploaded python-poolcounter to stretch,buster |
[production] |
| 08:57 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'test' . |
[production] |
| 08:29 |
<moritzm> |
upgrading PHP on contint* |
[production] |
| 08:18 |
<moritzm> |
installing puppetdb2002 |
[production] |
| 08:11 |
<marostegui> |
Stop MySQL on db2052 T230883 |
[production] |
| 08:11 |
<marostegui> |
Remove db2052 from tendril and zarcillo T230883 |
[production] |
| 08:05 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Remove db2052 from config T230883 (duration: 00m 54s) |
[production] |
| 08:04 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Remove db2052 from config T230883 (duration: 00m 54s) |
[production] |
| 07:58 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1122', diff saved to https://phabricator.wikimedia.org/P8953 and previous config saved to /var/cache/conftool/dbconfig/20190821-075813-marostegui.json |
[production] |
| 07:56 |
<ema> |
upload@eqsin: rolling ats-backend-restart to enable compress plugin |
[production] |
| 05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'More weight to db1122', diff saved to https://phabricator.wikimedia.org/P8952 and previous config saved to /var/cache/conftool/dbconfig/20190821-054542-marostegui.json |
[production] |
| 05:28 |
<eileen> |
civicrm revision changed from 0d1b7f107a to d7370a9d0b, config revision is 58cd6b7ae6 |
[production] |
| 05:26 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'More weight to db1122', diff saved to https://phabricator.wikimedia.org/P8951 and previous config saved to /var/cache/conftool/dbconfig/20190821-052613-marostegui.json |
[production] |
| 05:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1122 after restart', diff saved to https://phabricator.wikimedia.org/P8950 and previous config saved to /var/cache/conftool/dbconfig/20190821-051441-marostegui.json |
[production] |
| 05:05 |
<marostegui> |
Restart MySQL on db1122 for binlog format change - T230785 |
[production] |
| 05:05 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1122 for binlog format change', diff saved to https://phabricator.wikimedia.org/P8949 and previous config saved to /var/cache/conftool/dbconfig/20190821-050501-marostegui.json |
[production] |
| 05:04 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Clarify db1122 status: candidate master for s2 - T230785 (duration: 00m 55s) |
[production] |
| 02:28 |
<ebernhardson@deploy1001> |
Finished deploy [search/mjolnir/deploy@adff5ad]: bulk_daemon: Handle non-integer status_code in json response (duration: 04m 09s) |
[production] |
| 02:24 |
<ebernhardson@deploy1001> |
Started deploy [search/mjolnir/deploy@adff5ad]: bulk_daemon: Handle non-integer status_code in json response |
[production] |
|
2019-08-20
§
|
| 23:53 |
<ebernhardson@deploy1001> |
Finished deploy [search/mjolnir/deploy@a7bf6cf]: bulk_daemon: Increase bulk request_timeout (duration: 03m 40s) |
[production] |
| 23:50 |
<eileen> |
that just changes us to php7 csv so watch for any fail mail |
[production] |
| 23:49 |
<eileen> |
civicrm revision changed from 9c7b2ffbc9 to 0d1b7f107a, config revision is 58cd6b7ae6 |
[production] |
| 23:49 |
<ebernhardson@deploy1001> |
Started deploy [search/mjolnir/deploy@a7bf6cf]: bulk_daemon: Increase bulk request_timeout |
[production] |
| 23:42 |
<Urbanecm> |
Evening SWAT aborted due to no logs logged for some period of time (T230847), no patches were reverted |
[production] |
| 23:27 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: fd2cece: Enable RelatedArticles on all skins on eswikinews (T230660) (duration: 00m 52s) |
[production] |
| 23:22 |
<urbanecm@deploy1001> |
Synchronized wmf-config/throttle-analyze.php: SWAT: a3927a7: Grant skipcaptcha to everyone coming from whitelisted IP (T227487) (duration: 00m 54s) |
[production] |