|
2021-08-09
§
|
| 11:21 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: d6564351b28d3755369736f95c36063f8b980a22: dewiki: Enable Growth features in dark mode (T288420; 1/3) (duration: 00m 57s) |
[production] |
| 11:19 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:17 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:16 |
<urbanecm> |
[urbanecm@mwmaint2002 ~]$ mwscript extensions/GrowthExperiments/maintenance/initWikiConfig.php --wiki=dewiki --phab=T288420 # T288420 |
[production] |
| 11:15 |
<urbanecm> |
[urbanecm@mwmaint2002 ~]$ mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=dewiki growthexperiments # T288420 |
[production] |
| 11:15 |
<urbanecm@deploy1002> |
Synchronized dblists/commonsuploads.dblist: 9b9bb5b145fd67074c8122e0ddcba1b1e859bb78: Disable local uploads for non-administrators on nlwiki (T288386) (duration: 00m 57s) |
[production] |
| 11:11 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:11 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 037aceb7f575d77930627f5062e183d514616f16: Enable GeoData on zhwikinews (T287807) (duration: 00m 57s) |
[production] |
| 11:10 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:05 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on 15 hosts with reason: Reimage db1136 (s7 primary) to buster T288244 |
[production] |
| 11:04 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 5:00:00 on 15 hosts with reason: Reimage db1136 (s7 primary) to buster T288244 |
[production] |
| 11:04 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 54c532f4d05c6c3f8ab39d3693e481a92d1ccdf7: Add *.happysrv.de to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T288039) (duration: 00m 58s) |
[production] |
| 10:44 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:42 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:36 |
<ladsgroup@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710938|Enable shellbox constraint for commons wikis (T176312)]] (duration: 00m 57s) |
[production] |
| 10:35 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:33 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:31 |
<awight@deploy1002> |
sync-file aborted: Config: [[gerrit:709027|[beta] Enable new VE template dialog sidebar (T286765)]] (duration: 00m 23s) |
[production] |
| 10:27 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:27 |
<ladsgroup@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710936|Enable post edit constraint jobs in all edits (T204031)]] (duration: 00m 58s) |
[production] |
| 10:26 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 09:55 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 09:50 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 09:49 |
<ladsgroup@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710925|Increase post edit constraint jobs to 85% of edits (T204031)]] (duration: 00m 58s) |
[production] |
| 09:46 |
<hnowlan@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on maps1005.eqiad.wmnet with reason: REIMAGE |
[production] |
| 09:44 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on maps1005.eqiad.wmnet with reason: REIMAGE |
[production] |
| 09:31 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=maps200[1234].codfw.wmnet |
[production] |
| 08:46 |
<godog> |
upgrade prometheus on prometheus2004 - T222113 |
[production] |
| 08:41 |
<godog> |
upgrade prometheus on prometheus1004 - T222113 |
[production] |
| 08:36 |
<jynus@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbprov2002.codfw.wmnet with reason: REIMAGE |
[production] |
| 08:34 |
<jynus@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on dbprov2002.codfw.wmnet with reason: REIMAGE |
[production] |
| 08:24 |
<marostegui> |
Upgrade db1117 (all sections) to 10.4.19 |
[production] |
| 08:03 |
<ariel@deploy1002> |
Finished deploy [dumps/dumps@142e91c]: fix for T288192 runnerutils bug (duration: 00m 03s) |
[production] |
| 08:03 |
<ariel@deploy1002> |
Started deploy [dumps/dumps@142e91c]: fix for T288192 runnerutils bug |
[production] |
| 07:52 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1160 T288273', diff saved to https://phabricator.wikimedia.org/P16971 and previous config saved to /var/cache/conftool/dbconfig/20210809-075212-marostegui.json |
[production] |
| 07:50 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 07:45 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 07:30 |
<ladsgroup@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710919|Enable shellbox for constraint for all of wikidata (T176312)]] (duration: 00m 58s) |
[production] |
| 07:15 |
<marostegui> |
Stop db1117:3323 to clone db1107 - T288197 |
[production] |
| 07:05 |
<kart__> |
Updated cxserver to 2021-08-06-062053-production (T288272) |
[production] |
| 07:04 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1107.eqiad.wmnet with reason: REIMAGE |
[production] |
| 07:02 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db1107.eqiad.wmnet with reason: REIMAGE |
[production] |
| 06:53 |
<kartik@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 06:45 |
<kartik@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 05:56 |
<XioNoX> |
enable cloudsw1-c8 interfaces toward cloudsw2-c8 - T277340 |
[production] |
| 05:23 |
<marostegui> |
Lag in s4 (commonswiki) will appear on clouddb* hosts (wiki replicas) T288273 |
[production] |
| 05:22 |
<marostegui> |
Optimize commonswiki.image on eqiad, lag will appear - T288273 |
[production] |