2701-2750 of 10000 results (25ms)
2020-04-30 §
14:53 <krinkle@deploy1001> Synchronized wmf-config/db-eqiad.php: I46d2b811f6287689 (duration: 00m 57s) [production]
14:38 <krinkle@deploy1001> Synchronized wmf-config/db-codfw.php: I46d2b811f6287689 (duration: 00m 57s) [production]
14:24 <vgutierrez> upgrade trafficserver to 8.0.7-1wm2 on cp[5006,5011] [production]
14:13 <marostegui> Stop slave on es2020 for testing [production]
14:11 <vgutierrez> rolling restart of ats-tls on text@esams - T249335 [production]
14:01 <vgutierrez> upgrade trafficserver to version 8.0.7-1wm2 on cp4025 and cp4031 [production]
13:14 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:11 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:04 <liw@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.30 [production]
12:44 <arturo> re-enable puppet in apt1001 [production]
12:35 <jbond42> rolling restart of php7.2-fpm on mw1* servers [production]
12:09 <jbond42> rolling restart of thumbor service [production]
12:02 <arturo> disable puppet in apt1001 to briefly test a reprepro pull filter before merging a proper patch [production]
11:59 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:56 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:56 <jbond42> updating tiff on stretch [production]
11:54 <arturo> running `aborrero@apt1001:~ $ sudo -i reprepro --delete clearvanished` to clean unused openstack components and packages (see https://gerrit.wikimedia.org/r/c/operations/puppet/+/593223) [production]
11:30 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 83e1475: Uncoupling graphoid on testwiki (T242855) (duration: 01m 06s) [production]
11:07 <marostegui> Deploy schema change on db1091 [production]
11:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1091', diff saved to https://phabricator.wikimedia.org/P11099 and previous config saved to /var/cache/conftool/dbconfig/20200430-110721-marostegui.json [production]
11:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1084', diff saved to https://phabricator.wikimedia.org/P11098 and previous config saved to /var/cache/conftool/dbconfig/20200430-110539-marostegui.json [production]
11:05 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 6572e25: Enable transwiki import from wikidata, frwikisource and hiwikibooks in hiwikisource (T251485) (duration: 01m 12s) [production]
10:51 <mutante> bromine,vega,miscweb[12]002: rm -rf /srv/org/wikimedia/TransparencyReport-private [production]
10:09 <jayme> imported helm 2.12.2-4 to main for buster-wikimedia [production]
09:53 <jayme> imported helm3 3.2.0-1+deb10u1 to main for buster-wikimedia [production]
09:47 <kormat> reimaging db1077 for testing purposes T251392 [production]
08:36 <XioNoX> change blackhole term scope on all routers - T226742 [production]
07:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2089', diff saved to https://phabricator.wikimedia.org/P11097 and previous config saved to /var/cache/conftool/dbconfig/20200430-075211-marostegui.json [production]
07:31 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:29 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
06:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1111', diff saved to https://phabricator.wikimedia.org/P11096 and previous config saved to /var/cache/conftool/dbconfig/20200430-065044-marostegui.json [production]
06:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1111', diff saved to https://phabricator.wikimedia.org/P11095 and previous config saved to /var/cache/conftool/dbconfig/20200430-065008-marostegui.json [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2089', diff saved to https://phabricator.wikimedia.org/P11094 and previous config saved to /var/cache/conftool/dbconfig/20200430-064450-marostegui.json [production]
05:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1092', diff saved to https://phabricator.wikimedia.org/P11093 and previous config saved to /var/cache/conftool/dbconfig/20200430-051818-marostegui.json [production]
05:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1092', diff saved to https://phabricator.wikimedia.org/P11092 and previous config saved to /var/cache/conftool/dbconfig/20200430-051637-marostegui.json [production]
05:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1099:3318', diff saved to https://phabricator.wikimedia.org/P11091 and previous config saved to /var/cache/conftool/dbconfig/20200430-051506-marostegui.json [production]
05:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1099:3318', diff saved to https://phabricator.wikimedia.org/P11090 and previous config saved to /var/cache/conftool/dbconfig/20200430-051329-marostegui.json [production]
05:02 <marostegui> Restart x1 master finished - T250701 [production]
05:00 <marostegui> Restart x1 master (db1120) - T250701 [production]
04:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084', diff saved to https://phabricator.wikimedia.org/P11089 and previous config saved to /var/cache/conftool/dbconfig/20200430-045159-marostegui.json [production]
04:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1097:3314', diff saved to https://phabricator.wikimedia.org/P11088 and previous config saved to /var/cache/conftool/dbconfig/20200430-043803-marostegui.json [production]
00:26 <twentyafterfour> phabricator update finished [production]
00:15 <twentyafterfour> deploying phabricator update: https://phabricator.wikimedia.org/project/view/4620/ [production]
00:11 <eileen> process-control config revision is 1f31dd21c5 [production]
2020-04-29 §
23:55 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T91649 Drop Sentry, Part II: Stop configuring it for production or Beta Cluster (duration: 01m 05s) [production]
23:51 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T91649 Drop Sentry, Part I: Stop loading it anywhere (duration: 01m 05s) [production]
23:37 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set Growth Screener survey sample rate to 0.1% and limit to anons only (T248421) (duration: 01m 05s) [production]
23:26 <RoanKattouw> Ran updateArticleCount.php on trwikisource [production]
23:22 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set $wgArticleCount to any on trwikisource (duration: 01m 06s) [production]
21:59 <bstorm_> upgrading RAID firmware on labsdb1011 T249188 [production]