9851-9900 of 10000 results (76ms)
2020-02-24 ยง
22:38 <XioNoX> redirect ns2 to authdns1001 [production]
22:34 <mutante> stat1007 sudo systemctl reset-failed to clear Icinga alerts about reportupdater-pingback.service [production]
22:22 <XioNoX> disable transits on cr3-esams [production]
21:43 <ppchelko@deploy1001> Finished deploy [cpjobqueue/deploy@f87bdd9]: Take service name into account for consumer group name T244387 (duration: 01m 14s) [production]
21:42 <ppchelko@deploy1001> Started deploy [cpjobqueue/deploy@f87bdd9]: Take service name into account for consumer group name T244387 [production]
21:37 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
21:28 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]
21:26 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
21:23 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]
21:05 <eileen> civicrm revision changed from fffc215e75 to 87b13fd3b5, config revision is 561ae21f77 [production]
20:58 <XioNoX> test flowspec BGP config on cr3-knams [production]
20:32 <XioNoX> load new FW policies on pfw3-eqiad/codfw - T246036 [production]
20:29 <ejegg|food> updated Fundraising CiviCRM from 426e3547ca to fffc215e75 [production]
20:03 <eileen> civicrm revision changed from c086fd4e0b to 426e3547ca, config revision is 561ae21f77 [production]
20:02 <mutante> installing OS on new ganeti VMs apt1001 and apt2001.wikimedia.org for buster APT repos [production]
19:07 <jforrester@deploy1001> Synchronized multiversion/MWConfigCacheGenerator.php: Changes here areonly used in tests right now, but keep line numbers sync'ed (duration: 00m 56s) [production]
18:46 <mutante> deploying cluster apache config change - adds gr.wikimedia.org vhost and refreshes apache2 [production]
17:10 <jforrester@deploy1001> Synchronized wmf-config/flaggedrevs.php: Sync doc-only change; should be a no-op (duration: 00m 57s) [production]
16:18 <RhinosF1> tools.zppixbot changing logging_level from DEBUG --> INFO to avoid pointless logspam [production]
16:16 <jynus> reloading ferm on ms-be2028 DNS query timed out [production]
16:11 <jynus> reloading ferm on ms-be2043 DNS query timed out [production]
16:02 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]], take II (duration: 00m 56s) [production]
15:57 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]] (duration: 00m 56s) [production]
15:30 <moritzm> updated component/jdk8 to 8u242-b08-1~deb10u1 (forward port of latest Java 8 security update) [production]
15:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Reduce weight for db1126, increase it a bit for db1101:3318', diff saved to https://phabricator.wikimedia.org/P10498 and previous config saved to /var/cache/conftool/dbconfig/20200224-152132-marostegui.json [production]
15:05 <marostegui> Deploy schema change on db1086 (s7 master) with replication - T245925 [production]
14:59 <marostegui> read_only=0 on es1020 (es4) and es1023 (es5) - unused new external store masters - T245806 [production]
14:56 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]], take II (duration: 00m 55s) [production]
14:55 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]] (duration: 00m 57s) [production]
14:47 <andrew@deploy1001> Finished deploy [horizon/deploy@dab0ca0]: modest css change for the hiera editing dialog (take two -- I consistently forget to rebase before doing this) (duration: 03m 33s) [production]
14:44 <andrew@deploy1001> Started deploy [horizon/deploy@dab0ca0]: modest css change for the hiera editing dialog (take two -- I consistently forget to rebase before doing this) [production]
14:43 <andrew@deploy1001> Finished deploy [horizon/deploy@a8f2ea9]: modest css change for the hiera editing dialog (duration: 00m 12s) [production]
14:43 <andrew@deploy1001> Started deploy [horizon/deploy@a8f2ea9]: modest css change for the hiera editing dialog [production]
14:42 <marostegui> Compress innodb on wb_terms on db1087 - T232446 [production]
14:03 <_joe_> depooling esams (authdns-update) [production]
13:51 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q120K (T219123)]], take II (duration: 00m 55s) [production]
13:48 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q120K (T219123)]] (duration: 00m 56s) [production]
13:30 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q60K (T219123)]], take II (duration: 00m 56s) [production]
13:28 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q60K (T219123)]] (duration: 00m 56s) [production]
13:18 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q30K (T219123)]], take II (duration: 00m 56s) [production]
13:17 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q30K (T219123)]] (duration: 00m 56s) [production]
13:05 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 18s) [production]
13:01 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:573965|Disallow crats to (un)assign flow-bot group on enwiki (T245716)]] (duration: 00m 56s) [production]
12:59 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:573965|Disallow crats to (un)assign flow-bot group on enwiki (T245716)]] (duration: 00m 56s) [production]
12:48 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:574398| Bumping portals to master (563985)]] (duration: 00m 56s) [production]
12:47 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:574398| Bumping portals to master (563985)]] (duration: 00m 56s) [production]
12:38 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:571738|Add definitions for redirect badges (T235420)]], take II, the cache issue (duration: 00m 56s) [production]
12:37 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:571738|Add definitions for redirect badges (T235420)]] (duration: 00m 56s) [production]
12:23 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.20/extensions/Wikibase/client/includes: SWAT: [[gerrit:574391|Use formatter cache in client LUA label lookups (T245740)]] (duration: 00m 56s) [production]
12:19 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.20/extensions/WikimediaMaintenance/dumpInterwiki.php: dumpInterwiki: Respect comments in dblists (T244906) (duration: 00m 56s) [production]