801-850 of 10000 results (52ms)
2019-08-21 §
11:37 <elukey> restart celery-ores-worker on ores1002 [production]
10:57 <Urbanecm> Run scap pull on mwdebug1002 (T230601) [production]
10:52 <Urbanecm> Move 0a87e3c's code to abusefilter.php on mwdebug1002 (T230601) [production]
10:49 <Urbanecm> Previous log entry was for mwdebug1002 [production]
10:49 <Urbanecm> Wrapped code added to CommonSettings.php in T230601 to wgExtensionFunctions [production]
10:45 <Urbanecm> Run mwscript namespaceDupes.php --wiki=zhwikisource --add-prefix=FIXME --fix (T230548) [production]
10:02 <moritzm> installing puppetdb1002 [production]
09:46 <tarrow> finished enabling termbox on wikidatawiki [production]
09:36 <tarrow@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:531433|Enable Termbox on wikidatawiki (T230896)]] (duration: 00m 55s) [production]
09:29 <moritzm> rebooting db2102 (reverting to a proper stretch 4.9 kernel, it used a bpo kernel due to some hardware debuging a while back) [production]
09:20 <@> helmfile [EQIAD] Ran 'apply' command on namespace 'termbox' for release 'production' . [production]
09:15 <@> helmfile [CODFW] Ran 'apply' command on namespace 'termbox' for release 'production' . [production]
09:09 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:09 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:09 <@> helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'staging' . [production]
09:07 <_joe_> uploaded python-poolcounter to stretch,buster [production]
08:57 <@> helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'test' . [production]
08:29 <moritzm> upgrading PHP on contint* [production]
08:18 <moritzm> installing puppetdb2002 [production]
08:11 <marostegui> Stop MySQL on db2052 T230883 [production]
08:11 <marostegui> Remove db2052 from tendril and zarcillo T230883 [production]
08:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2052 from config T230883 (duration: 00m 54s) [production]
08:04 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2052 from config T230883 (duration: 00m 54s) [production]
07:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1122', diff saved to https://phabricator.wikimedia.org/P8953 and previous config saved to /var/cache/conftool/dbconfig/20190821-075813-marostegui.json [production]
07:56 <ema> upload@eqsin: rolling ats-backend-restart to enable compress plugin [production]
05:45 <marostegui@cumin1001> dbctl commit (dc=all): 'More weight to db1122', diff saved to https://phabricator.wikimedia.org/P8952 and previous config saved to /var/cache/conftool/dbconfig/20190821-054542-marostegui.json [production]
05:28 <eileen> civicrm revision changed from 0d1b7f107a to d7370a9d0b, config revision is 58cd6b7ae6 [production]
05:26 <marostegui@cumin1001> dbctl commit (dc=all): 'More weight to db1122', diff saved to https://phabricator.wikimedia.org/P8951 and previous config saved to /var/cache/conftool/dbconfig/20190821-052613-marostegui.json [production]
05:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1122 after restart', diff saved to https://phabricator.wikimedia.org/P8950 and previous config saved to /var/cache/conftool/dbconfig/20190821-051441-marostegui.json [production]
05:05 <marostegui> Restart MySQL on db1122 for binlog format change - T230785 [production]
05:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1122 for binlog format change', diff saved to https://phabricator.wikimedia.org/P8949 and previous config saved to /var/cache/conftool/dbconfig/20190821-050501-marostegui.json [production]
05:04 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Clarify db1122 status: candidate master for s2 - T230785 (duration: 00m 55s) [production]
02:28 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@adff5ad]: bulk_daemon: Handle non-integer status_code in json response (duration: 04m 09s) [production]
02:24 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@adff5ad]: bulk_daemon: Handle non-integer status_code in json response [production]
2019-08-20 §
23:53 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@a7bf6cf]: bulk_daemon: Increase bulk request_timeout (duration: 03m 40s) [production]
23:50 <eileen> that just changes us to php7 csv so watch for any fail mail [production]
23:49 <eileen> civicrm revision changed from 9c7b2ffbc9 to 0d1b7f107a, config revision is 58cd6b7ae6 [production]
23:49 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@a7bf6cf]: bulk_daemon: Increase bulk request_timeout [production]
23:42 <Urbanecm> Evening SWAT aborted due to no logs logged for some period of time (T230847), no patches were reverted [production]
23:27 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: fd2cece: Enable RelatedArticles on all skins on eswikinews (T230660) (duration: 00m 52s) [production]
23:22 <urbanecm@deploy1001> Synchronized wmf-config/throttle-analyze.php: SWAT: a3927a7: Grant skipcaptcha to everyone coming from whitelisted IP (T227487) (duration: 00m 54s) [production]
23:19 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 13be059: Disable Wikimedia ReadingDepth (T229042) (duration: 00m 56s) [production]
23:16 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 0c08257: Remove unused remnant from old menu click tracking (T228681) (duration: 00m 55s) [production]
23:10 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: b94b647: Update wgSkipSkins to experiment with not showing skins to users (T223824) (duration: 00m 58s) [production]
21:20 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@9b40607]: bulk_daemon: Increase max_poll_interval_ms to 15 minutes (duration: 06m 22s) [production]
21:14 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@9b40607]: bulk_daemon: Increase max_poll_interval_ms to 15 minutes [production]
20:49 <XioNoX> push BGP_Wikimedia_pops to ams - T227808 [production]
19:28 <XioNoX> push BGP_Wikimedia_pops to eqsin - T227808 [production]
19:25 <thcipriani> cleanup old (pre 1.34.0-wmf.14) wmf/* branches for core and extensions on gerrit [production]
19:25 <XioNoX> push BGP_Wikimedia_pops to cr4-ulsfo - T227808 [production]