6751-6800 of 10000 results (25ms)
2020-04-30 §
12:02 <arturo> disable puppet in apt1001 to briefly test a reprepro pull filter before merging a proper patch [production]
11:59 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:56 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:56 <jbond42> updating tiff on stretch [production]
11:54 <arturo> running `aborrero@apt1001:~ $ sudo -i reprepro --delete clearvanished` to clean unused openstack components and packages (see https://gerrit.wikimedia.org/r/c/operations/puppet/+/593223) [production]
11:30 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 83e1475: Uncoupling graphoid on testwiki (T242855) (duration: 01m 06s) [production]
11:07 <marostegui> Deploy schema change on db1091 [production]
11:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1091', diff saved to https://phabricator.wikimedia.org/P11099 and previous config saved to /var/cache/conftool/dbconfig/20200430-110721-marostegui.json [production]
11:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1084', diff saved to https://phabricator.wikimedia.org/P11098 and previous config saved to /var/cache/conftool/dbconfig/20200430-110539-marostegui.json [production]
11:05 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 6572e25: Enable transwiki import from wikidata, frwikisource and hiwikibooks in hiwikisource (T251485) (duration: 01m 12s) [production]
10:51 <mutante> bromine,vega,miscweb[12]002: rm -rf /srv/org/wikimedia/TransparencyReport-private [production]
10:09 <jayme> imported helm 2.12.2-4 to main for buster-wikimedia [production]
09:53 <jayme> imported helm3 3.2.0-1+deb10u1 to main for buster-wikimedia [production]
09:47 <kormat> reimaging db1077 for testing purposes T251392 [production]
08:36 <XioNoX> change blackhole term scope on all routers - T226742 [production]
07:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2089', diff saved to https://phabricator.wikimedia.org/P11097 and previous config saved to /var/cache/conftool/dbconfig/20200430-075211-marostegui.json [production]
07:31 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:29 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
06:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1111', diff saved to https://phabricator.wikimedia.org/P11096 and previous config saved to /var/cache/conftool/dbconfig/20200430-065044-marostegui.json [production]
06:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1111', diff saved to https://phabricator.wikimedia.org/P11095 and previous config saved to /var/cache/conftool/dbconfig/20200430-065008-marostegui.json [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2089', diff saved to https://phabricator.wikimedia.org/P11094 and previous config saved to /var/cache/conftool/dbconfig/20200430-064450-marostegui.json [production]
05:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1092', diff saved to https://phabricator.wikimedia.org/P11093 and previous config saved to /var/cache/conftool/dbconfig/20200430-051818-marostegui.json [production]
05:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1092', diff saved to https://phabricator.wikimedia.org/P11092 and previous config saved to /var/cache/conftool/dbconfig/20200430-051637-marostegui.json [production]
05:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1099:3318', diff saved to https://phabricator.wikimedia.org/P11091 and previous config saved to /var/cache/conftool/dbconfig/20200430-051506-marostegui.json [production]
05:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1099:3318', diff saved to https://phabricator.wikimedia.org/P11090 and previous config saved to /var/cache/conftool/dbconfig/20200430-051329-marostegui.json [production]
05:02 <marostegui> Restart x1 master finished - T250701 [production]
05:00 <marostegui> Restart x1 master (db1120) - T250701 [production]
04:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084', diff saved to https://phabricator.wikimedia.org/P11089 and previous config saved to /var/cache/conftool/dbconfig/20200430-045159-marostegui.json [production]
04:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1097:3314', diff saved to https://phabricator.wikimedia.org/P11088 and previous config saved to /var/cache/conftool/dbconfig/20200430-043803-marostegui.json [production]
00:26 <twentyafterfour> phabricator update finished [production]
00:15 <twentyafterfour> deploying phabricator update: https://phabricator.wikimedia.org/project/view/4620/ [production]
00:11 <eileen> process-control config revision is 1f31dd21c5 [production]
2020-04-29 §
23:55 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T91649 Drop Sentry, Part II: Stop configuring it for production or Beta Cluster (duration: 01m 05s) [production]
23:51 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T91649 Drop Sentry, Part I: Stop loading it anywhere (duration: 01m 05s) [production]
23:37 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set Growth Screener survey sample rate to 0.1% and limit to anons only (T248421) (duration: 01m 05s) [production]
23:26 <RoanKattouw> Ran updateArticleCount.php on trwikisource [production]
23:22 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set $wgArticleCount to any on trwikisource (duration: 01m 06s) [production]
21:59 <bstorm_> upgrading RAID firmware on labsdb1011 T249188 [production]
21:34 <volker-e@deploy1001> Finished deploy [design/style-guide@c4956c3]: Deploy design/style-guide: (duration: 00m 08s) [production]
21:34 <volker-e@deploy1001> Started deploy [design/style-guide@c4956c3]: Deploy design/style-guide: [production]
21:22 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.28/extensions/GlobalBlocking/includes/api/ApiQueryGlobalBlocks.php: T251430 Unconditionally select gb_timestamp (duration: 01m 06s) [production]
21:19 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.30/extensions/GlobalBlocking/includes/api/ApiQueryGlobalBlocks.php: T251430 Unconditionally select gb_timestamp (duration: 01m 05s) [production]
21:17 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.30/extensions/Quiz/includes/Quiz.php: Don't crash if quiz attempts to include a bad title T251409 (duration: 01m 06s) [production]
20:11 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:09 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:46 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: (doc-only) Fix Phabricator task reference for jvwiki logo (duration: 01m 05s) [production]
19:34 <addshore> repool wdqs2008 [production]
19:02 <addshore> depooling and stopping the updater on wdqs2008 for some query tests (wdqs-internal) [production]
17:56 <joal@deploy1001> Finished deploy [analytics/refinery@6460d05] (thin): Regular analytics weekly train THIN [6460d05] (duration: 00m 08s) [production]
17:56 <joal@deploy1001> Started deploy [analytics/refinery@6460d05] (thin): Regular analytics weekly train THIN [6460d05] [production]