6601-6650 of 10000 results (40ms)
2021-08-09 §
11:23 <urbanecm@deploy1002> Synchronized dblists/growthexperiments.dblist: d6564351b28d3755369736f95c36063f8b980a22: dewiki: Enable Growth features in dark mode (T288420; 2/3) (duration: 00m 57s) [production]
11:21 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: d6564351b28d3755369736f95c36063f8b980a22: dewiki: Enable Growth features in dark mode (T288420; 1/3) (duration: 00m 57s) [production]
11:19 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:16 <urbanecm> [urbanecm@mwmaint2002 ~]$ mwscript extensions/GrowthExperiments/maintenance/initWikiConfig.php --wiki=dewiki --phab=T288420 # T288420 [production]
11:15 <urbanecm> [urbanecm@mwmaint2002 ~]$ mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=dewiki growthexperiments # T288420 [production]
11:15 <urbanecm@deploy1002> Synchronized dblists/commonsuploads.dblist: 9b9bb5b145fd67074c8122e0ddcba1b1e859bb78: Disable local uploads for non-administrators on nlwiki (T288386) (duration: 00m 57s) [production]
11:11 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:11 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 037aceb7f575d77930627f5062e183d514616f16: Enable GeoData on zhwikinews (T287807) (duration: 00m 57s) [production]
11:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:05 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on 15 hosts with reason: Reimage db1136 (s7 primary) to buster T288244 [production]
11:04 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 5:00:00 on 15 hosts with reason: Reimage db1136 (s7 primary) to buster T288244 [production]
11:04 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 54c532f4d05c6c3f8ab39d3693e481a92d1ccdf7: Add *.happysrv.de to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T288039) (duration: 00m 58s) [production]
10:44 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:42 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:36 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710938|Enable shellbox constraint for commons wikis (T176312)]] (duration: 00m 57s) [production]
10:35 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:33 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:31 <awight@deploy1002> sync-file aborted: Config: [[gerrit:709027|[beta] Enable new VE template dialog sidebar (T286765)]] (duration: 00m 23s) [production]
10:27 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:27 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710936|Enable post edit constraint jobs in all edits (T204031)]] (duration: 00m 58s) [production]
10:26 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:55 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:50 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:49 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710925|Increase post edit constraint jobs to 85% of edits (T204031)]] (duration: 00m 58s) [production]
09:46 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on maps1005.eqiad.wmnet with reason: REIMAGE [production]
09:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on maps1005.eqiad.wmnet with reason: REIMAGE [production]
09:31 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps200[1234].codfw.wmnet [production]
08:46 <godog> upgrade prometheus on prometheus2004 - T222113 [production]
08:41 <godog> upgrade prometheus on prometheus1004 - T222113 [production]
08:36 <jynus@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbprov2002.codfw.wmnet with reason: REIMAGE [production]
08:34 <jynus@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dbprov2002.codfw.wmnet with reason: REIMAGE [production]
08:24 <marostegui> Upgrade db1117 (all sections) to 10.4.19 [production]
08:03 <ariel@deploy1002> Finished deploy [dumps/dumps@142e91c]: fix for T288192 runnerutils bug (duration: 00m 03s) [production]
08:03 <ariel@deploy1002> Started deploy [dumps/dumps@142e91c]: fix for T288192 runnerutils bug [production]
07:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1160 T288273', diff saved to https://phabricator.wikimedia.org/P16971 and previous config saved to /var/cache/conftool/dbconfig/20210809-075212-marostegui.json [production]
07:50 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
07:45 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
07:30 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710919|Enable shellbox for constraint for all of wikidata (T176312)]] (duration: 00m 58s) [production]
07:15 <marostegui> Stop db1117:3323 to clone db1107 - T288197 [production]
07:05 <kart__> Updated cxserver to 2021-08-06-062053-production (T288272) [production]
07:04 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1107.eqiad.wmnet with reason: REIMAGE [production]
07:02 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1107.eqiad.wmnet with reason: REIMAGE [production]
06:53 <kartik@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
06:45 <kartik@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
05:56 <XioNoX> enable cloudsw1-c8 interfaces toward cloudsw2-c8 - T277340 [production]
05:23 <marostegui> Lag in s4 (commonswiki) will appear on clouddb* hosts (wiki replicas) T288273 [production]
05:22 <marostegui> Optimize commonswiki.image on eqiad, lag will appear - T288273 [production]
2021-08-06 §
19:17 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:12 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]