|
2021-09-23
ยง
|
| 13:25 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx1001.wikimedia.org with reason: reimage |
[production] |
| 13:25 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 1:00:00 on mx1001.wikimedia.org with reason: reimage |
[production] |
| 13:23 |
<jbond> |
merge refactor of resolv.conf puppet class - (gerrit 717241) |
[production] |
| 13:14 |
<marostegui> |
Deploy schema change on s4 {commonswiki,testcommonswiki}.wb_changes T291584 |
[production] |
| 13:11 |
<marostegui> |
Deploy schema change on s3 testwikidatawiki.wb_changes T291584 |
[production] |
| 13:09 |
<elukey> |
update pcc facts (after change in puppetdb's fact filter list, to allow partitions for analytics) |
[production] |
| 11:24 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:21 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:19 |
<marostegui> |
Upgrade db2081 db2082 db2083 db2084 db2091 db2152 T290868 |
[production] |
| 11:16 |
<kostajh> |
UTC morning backport and config deploys done |
[production] |
| 11:15 |
<kharlan@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:722961|GrowthExperiments: Place new dewiki accounts in control group (T288420)]] (duration: 01m 06s) |
[production] |
| 11:10 |
<jynus> |
restart and upgrade db2141 T290865 |
[production] |
| 10:55 |
<mvolz@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . |
[production] |
| 10:53 |
<moritzm> |
mx1001 filterered on the routers for forthcoming reimage to bullseye T286911 |
[production] |
| 10:52 |
<mvolz@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . |
[production] |
| 10:51 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host sretest1002.eqiad.wmnet |
[production] |
| 10:50 |
<marostegui> |
Upgrade db2102 db2116 db2130 db2145 db2146 |
[production] |
| 10:47 |
<mvolz@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'zotero' for release 'staging' . |
[production] |
| 10:27 |
<volans@cumin1001> |
START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet |
[production] |
| 09:59 |
<jiji@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . |
[production] |
| 09:55 |
<jiji@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . |
[production] |
| 09:52 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for mx2002.wikimedia.org: Renew puppet certificate - jmm@cumin2002 |
[production] |
| 09:52 |
<jmm@cumin2002> |
START - Cookbook sre.puppet.renew-cert for mx2002.wikimedia.org: Renew puppet certificate - jmm@cumin2002 |
[production] |
| 09:51 |
<jiji@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . |
[production] |
| 09:40 |
<moritzm> |
reinstalling mx2002 (test server) to validate bullseye installs are fixed |
[production] |
| 09:31 |
<jiji@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . |
[production] |
| 09:30 |
<jiji@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . |
[production] |
| 09:29 |
<jiji@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . |
[production] |
| 08:16 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 08:12 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 08:04 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 08:04 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Have SyntaxHighlight use Shellbox service on group0 wikis (2/2) (T289227) (duration: 01m 05s) |
[production] |
| 08:02 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have SyntaxHighlight use Shellbox service on group0 wikis (1/2) (T289227) (duration: 01m 06s) |
[production] |
| 08:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 07:54 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Rename $wmgUseGeSHi to $wmgUseSyntaxHighlight (3/3) (duration: 01m 05s) |
[production] |
| 07:52 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Rename $wmgUseGeSHi to $wmgUseSyntaxHighlight (2/3) (duration: 01m 05s) |
[production] |
| 07:49 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Rename $wmgUseGeSHi to $wmgUseSyntaxHighlight (1/3) (duration: 01m 06s) |
[production] |
| 07:10 |
<tgr> |
running `mwscript extensions/GrowthExperiments/maintenance/fixLinkRecommendationData.php --wiki=$WIKI --search-index --db-table --statsd` for growthexperiments.dblist wikis |
[production] |
| 07:01 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. |
[production] |
| 07:01 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. |
[production] |
| 06:59 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. |
[production] |
| 06:59 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. |
[production] |
| 06:57 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 06:57 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 06:56 |
<marostegui> |
Upgrade db2116 |
[production] |
| 06:55 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 06:55 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 06:55 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. |
[production] |
| 06:55 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. |
[production] |
| 06:53 |
<marostegui> |
Upgrade db2085, db2088 and db2092 |
[production] |