101-150 of 10000 results (19ms)
2020-09-23 §
12:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2074', diff saved to https://phabricator.wikimedia.org/P12760 and previous config saved to /var/cache/conftool/dbconfig/20200923-123806-marostegui.json [production]
12:37 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:37 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:36 <kormat@cumin1001> dbctl commit (dc=all): 'Add db2088:3312 to api while db2104 gets depooled T259831', diff saved to https://phabricator.wikimedia.org/P12759 and previous config saved to /var/cache/conftool/dbconfig/20200923-123649-kormat.json [production]
12:35 <marostegui@cumin1001> dbctl commit (dc=all): 'db2074 (re)pooling @ 25%: Slowly db2074 ', diff saved to https://phabricator.wikimedia.org/P12758 and previous config saved to /var/cache/conftool/dbconfig/20200923-123528-root.json [production]
12:22 <ema> cp4027: repool with varnish 6.0.6-1wm1 T263557 [production]
12:09 <ema> cp4027: depool and upgrade varnish to 6.0.6-1wm1 T263557 [production]
11:52 <moritzm> installing GNUTLS bugfix updates from buster 10.5 point release [production]
11:51 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.10/extensions/GrowthExperiments/modules/homepage/suggestededits/ext.growthExperiments.Homepage.GrowthTasksApi.js: 73b5ce82b3913232b708405147f0bb6d27128974: Fix GrowthTasksApi lazy-loading flags for pages with no views (T263611) (duration: 01m 05s) [production]
11:49 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.10/extensions/GrowthExperiments/modules/help/ext.growthExperiments.PostEdit.js: 1ab31a966edc4748f82f75bb370371733c2ca090: Mark pageviews as not used in the mobile postedit notice (T263611) (duration: 01m 06s) [production]
11:38 <Urbanecm> Revert https://gerrit.wikimedia.org/r/c/mediawiki/core/+/629188 and fetch to deploy1001 to unblock EU B&C deployment (T237467; cc twentyafterfour) [production]
11:27 <kormat@cumin1001> dbctl commit (dc=all): 'db2088:3312 (re)pooling @ 100%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12756 and previous config saved to /var/cache/conftool/dbconfig/20200923-112712-kormat.json [production]
11:12 <kormat@cumin1001> dbctl commit (dc=all): 'db2088:3312 (re)pooling @ 75%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12755 and previous config saved to /var/cache/conftool/dbconfig/20200923-111209-kormat.json [production]
11:08 <Urbanecm> Create ContentTranslation tables at testwiki using SQL files from `/srv/mediawiki/php-1.36.0-wmf.10/extensions/ContentTranslation/sql` (T263417 [production]
10:57 <kormat@cumin1001> dbctl commit (dc=all): 'db2088:3312 (re)pooling @ 50%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12754 and previous config saved to /var/cache/conftool/dbconfig/20200923-105705-kormat.json [production]
10:42 <kormat@cumin1001> dbctl commit (dc=all): 'db2088:3312 (re)pooling @ 25%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12753 and previous config saved to /var/cache/conftool/dbconfig/20200923-104202-kormat.json [production]
10:21 <kormat@cumin1001> dbctl commit (dc=all): 'db2088:3312 depooling: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12752 and previous config saved to /var/cache/conftool/dbconfig/20200923-102120-kormat.json [production]
10:20 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:20 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db2084 after index changes T262856', diff saved to https://phabricator.wikimedia.org/P12751 and previous config saved to /var/cache/conftool/dbconfig/20200923-100156-marostegui.json [production]
10:01 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:629133|Configure entityDataCachePaths for Wikibase]] (duration: 01m 05s) [production]
09:59 <elukey> update puppet compilter's facts [production]
09:57 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:620050|Remove $wgExtraLanguageNames from Wikidata and Commons (T260118)]], part 2/2 (production no-op) (duration: 01m 04s) [production]
09:55 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:620050|Remove $wgExtraLanguageNames from Wikidata and Commons (T260118)]], part 1/2 (duration: 01m 16s) [production]
09:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db2084 after index changes T262856', diff saved to https://phabricator.wikimedia.org/P12750 and previous config saved to /var/cache/conftool/dbconfig/20200923-094511-marostegui.json [production]
08:32 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db2084 after index changes T262856', diff saved to https://phabricator.wikimedia.org/P12748 and previous config saved to /var/cache/conftool/dbconfig/20200923-083200-marostegui.json [production]
08:29 <moritzm> installing dbus security updates on buster [production]
08:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db2084 after index changes T262856', diff saved to https://phabricator.wikimedia.org/P12747 and previous config saved to /var/cache/conftool/dbconfig/20200923-080651-marostegui.json [production]
07:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db2084 after index changes T262856', diff saved to https://phabricator.wikimedia.org/P12746 and previous config saved to /var/cache/conftool/dbconfig/20200923-071129-marostegui.json [production]
07:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2084 to re-add change_revision_id index T262856', diff saved to https://phabricator.wikimedia.org/P12745 and previous config saved to /var/cache/conftool/dbconfig/20200923-070926-marostegui.json [production]
06:34 <marostegui> Stop MySQL on es2012 and es2018 T263613 T263615 [production]
06:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es2018 T263615', diff saved to https://phabricator.wikimedia.org/P12744 and previous config saved to /var/cache/conftool/dbconfig/20200923-063140-marostegui.json [production]
06:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es2012 for decommmissioning', diff saved to https://phabricator.wikimedia.org/P12743 and previous config saved to /var/cache/conftool/dbconfig/20200923-060812-marostegui.json [production]
05:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db2084 after index removal T262856', diff saved to https://phabricator.wikimedia.org/P12742 and previous config saved to /var/cache/conftool/dbconfig/20200923-055850-marostegui.json [production]
05:55 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2084 T262856', diff saved to https://phabricator.wikimedia.org/P12741 and previous config saved to /var/cache/conftool/dbconfig/20200923-055531-marostegui.json [production]
05:37 <marostegui> Purge global_status_log table on tendril - T252331 [production]
05:33 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
05:16 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
05:03 <marostegui> Remove triggers from db2094:3313 for MCR schema change T238966 [production]
05:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2074 for MCR schema change', diff saved to https://phabricator.wikimedia.org/P12739 and previous config saved to /var/cache/conftool/dbconfig/20200923-050234-marostegui.json [production]
04:25 <eileen> civicrm revision changed from 8f32b6301f to a789afd79b, config revision is 9933605187 [production]
2020-09-22 §
23:27 <legoktm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: clientError: enable on ja,es,de,ru,it,zh,pt wikipedias (T255585) (duration: 01m 04s) [production]
23:23 <legoktm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable watchlist expiry feature (T261249) (duration: 01m 06s) [production]
21:50 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
21:48 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
20:46 <ebernhardson> T259539 enabled adaptive replica selection on elasticsearch at search.svc.eqiad.wmnet:9[246]43 [production]
20:44 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:43 <dancy@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.10 [production]
20:42 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
20:31 <dancy@deploy1001> Finished scap: testwikis wikis to 1.36.0-wmf.10 (duration: 42m 21s) [production]