3701-3750 of 10000 results (76ms)
2020-02-24 ยง
20:02 <mutante> installing OS on new ganeti VMs apt1001 and apt2001.wikimedia.org for buster APT repos [production]
19:07 <jforrester@deploy1001> Synchronized multiversion/MWConfigCacheGenerator.php: Changes here areonly used in tests right now, but keep line numbers sync'ed (duration: 00m 56s) [production]
18:46 <mutante> deploying cluster apache config change - adds gr.wikimedia.org vhost and refreshes apache2 [production]
17:10 <jforrester@deploy1001> Synchronized wmf-config/flaggedrevs.php: Sync doc-only change; should be a no-op (duration: 00m 57s) [production]
16:18 <RhinosF1> tools.zppixbot changing logging_level from DEBUG --> INFO to avoid pointless logspam [production]
16:16 <jynus> reloading ferm on ms-be2028 DNS query timed out [production]
16:11 <jynus> reloading ferm on ms-be2043 DNS query timed out [production]
16:02 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]], take II (duration: 00m 56s) [production]
15:57 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]] (duration: 00m 56s) [production]
15:30 <moritzm> updated component/jdk8 to 8u242-b08-1~deb10u1 (forward port of latest Java 8 security update) [production]
15:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Reduce weight for db1126, increase it a bit for db1101:3318', diff saved to https://phabricator.wikimedia.org/P10498 and previous config saved to /var/cache/conftool/dbconfig/20200224-152132-marostegui.json [production]
15:05 <marostegui> Deploy schema change on db1086 (s7 master) with replication - T245925 [production]
14:59 <marostegui> read_only=0 on es1020 (es4) and es1023 (es5) - unused new external store masters - T245806 [production]
14:56 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]], take II (duration: 00m 55s) [production]
14:55 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q256K (T219123)]] (duration: 00m 57s) [production]
14:47 <andrew@deploy1001> Finished deploy [horizon/deploy@dab0ca0]: modest css change for the hiera editing dialog (take two -- I consistently forget to rebase before doing this) (duration: 03m 33s) [production]
14:44 <andrew@deploy1001> Started deploy [horizon/deploy@dab0ca0]: modest css change for the hiera editing dialog (take two -- I consistently forget to rebase before doing this) [production]
14:43 <andrew@deploy1001> Finished deploy [horizon/deploy@a8f2ea9]: modest css change for the hiera editing dialog (duration: 00m 12s) [production]
14:43 <andrew@deploy1001> Started deploy [horizon/deploy@a8f2ea9]: modest css change for the hiera editing dialog [production]
14:42 <marostegui> Compress innodb on wb_terms on db1087 - T232446 [production]
14:03 <_joe_> depooling esams (authdns-update) [production]
13:51 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q120K (T219123)]], take II (duration: 00m 55s) [production]
13:48 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q120K (T219123)]] (duration: 00m 56s) [production]
13:30 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q60K (T219123)]], take II (duration: 00m 56s) [production]
13:28 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q60K (T219123)]] (duration: 00m 56s) [production]
13:18 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q30K (T219123)]], take II (duration: 00m 56s) [production]
13:17 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:574454|Increase the reads for term store for clients for up to Q30K (T219123)]] (duration: 00m 56s) [production]
13:05 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 18s) [production]
13:01 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:573965|Disallow crats to (un)assign flow-bot group on enwiki (T245716)]] (duration: 00m 56s) [production]
12:59 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:573965|Disallow crats to (un)assign flow-bot group on enwiki (T245716)]] (duration: 00m 56s) [production]
12:48 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:574398| Bumping portals to master (563985)]] (duration: 00m 56s) [production]
12:47 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:574398| Bumping portals to master (563985)]] (duration: 00m 56s) [production]
12:38 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:571738|Add definitions for redirect badges (T235420)]], take II, the cache issue (duration: 00m 56s) [production]
12:37 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:571738|Add definitions for redirect badges (T235420)]] (duration: 00m 56s) [production]
12:23 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.20/extensions/Wikibase/client/includes: SWAT: [[gerrit:574391|Use formatter cache in client LUA label lookups (T245740)]] (duration: 00m 56s) [production]
12:19 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.20/extensions/WikimediaMaintenance/dumpInterwiki.php: dumpInterwiki: Respect comments in dblists (T244906) (duration: 00m 56s) [production]
12:12 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|574265|CX: Adjust MT threshold for Telugu WP to 70% (T244769)]] (duration: 00m 56s) [production]
12:05 <XioNoX> re-enable deactivated BGP sessions from ulsfo to office - T239893 [production]
12:02 <vgutierrez> reimage pybal-test2001 as buster - T224570 T245984 [production]
11:49 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:574398| Bumping portals to master (563985)]] (duration: 00m 55s) [production]
11:45 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:574398| Bumping portals to master (563985)]] (duration: 00m 57s) [production]
11:27 <vgutierrez> upload pybal 1.15.8 to apt.wm.o (buster) - T245984 [production]
11:06 <volans> restarted ferm on ms-be2046 [production]
11:02 <marostegui> Move labsdb1009, labsdb1011 and labsdb1012 (labsdb1010 is currently delayed, will be done later) to replicate under codfw for a few days while we alter wb_terms on db1087 - T232446 [production]
10:59 <effie> upgrading scap in eqiad and codfw - T245530 [production]
10:55 <volans> restarted ferm on ms-be2016, had failed with DNS query for 'ms-be2056.codfw.wmnet' failed: query timed out [production]
10:41 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.20/extensions/Wikibase: [[gerrit:574386|Add metric for recording cache hits in StatsdRecordingSimpleCache]] (T244260) (duration: 01m 04s) [production]
10:34 <godog> onboard netbox to logging pipeline [production]
10:12 <marostegui> Stop db1087 and db2079 in sync - T232446 [production]
10:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1087 for compression and place db1101:3318 into vslow,dump - T232446', diff saved to https://phabricator.wikimedia.org/P10493 and previous config saved to /var/cache/conftool/dbconfig/20200224-101030-marostegui.json [production]