|
2022-09-21
ยง
|
| 23:34 |
<zabe> |
shutoff deployment-db08 # T318126 |
[releng] |
| 23:00 |
<jeena> |
restarting zuul to try and fix CI issues |
[releng] |
| 20:51 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:50 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:50 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:50 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:46 |
<tgr_> |
UTC late deploys done |
[production] |
| 20:46 |
<zabe> |
clone deployment-db10 from deployment-db08 # T318126 |
[releng] |
| 20:45 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:44 |
<tgr@deploy1002> |
Synchronized php-1.40.0-wmf.2/extensions/WikimediaEvents/includes/BlockMetrics/BlockMetricsHooks.php: Backport: [[gerrit:833810|Block metrics: Bump schema to un-require some fields (T317343)]] (duration: 03m 42s) |
[production] |
| 20:44 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:43 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:36 |
<tgr@deploy1002> |
Synchronized php-1.40.0-wmf.1/extensions/WikimediaEvents/includes/BlockMetrics/BlockMetricsHooks.php: Backport: [[gerrit:833809|Block metrics: Bump schema to un-require some fields (T317343)]] (duration: 03m 55s) |
[production] |
| 20:29 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:28 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:28 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:25 |
<samtar@deploy1002> |
Finished scap: Backport for [[gerrit:833463|cirrus: Limit shard count to 1 in deployment-prep (T316711)]] (duration: 04m 19s) |
[production] |
| 20:22 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:21 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:21 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:21 |
<samtar@deploy1002> |
samtar and ebernhardson: Backport for [[gerrit:833463|cirrus: Limit shard count to 1 in deployment-prep (T316711)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 20:20 |
<samtar@deploy1002> |
Started scap: Backport for [[gerrit:833463|cirrus: Limit shard count to 1 in deployment-prep (T316711)]] |
[production] |
| 20:20 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:17 |
<samtar@deploy1002> |
Finished scap: Backport for [[gerrit:833837|Enable DiscussionTools visual enhancements as beta on en/dewiki (T315625)]] (duration: 05m 31s) |
[production] |
| 20:15 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:12 |
<samtar@deploy1002> |
samtar and kemayo: Backport for [[gerrit:833837|Enable DiscussionTools visual enhancements as beta on en/dewiki (T315625)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 20:11 |
<samtar@deploy1002> |
Started scap: Backport for [[gerrit:833837|Enable DiscussionTools visual enhancements as beta on en/dewiki (T315625)]] |
[production] |
| 20:11 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:11 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:10 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:09 |
<samtar@deploy1002> |
Finished scap: Backport for [[gerrit:833830|Remove deployment-db08 (T318126)]] (duration: 05m 16s) |
[production] |
| 20:04 |
<samtar@deploy1002> |
samtar and zabe: Backport for [[gerrit:833830|Remove deployment-db08 (T318126)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 20:04 |
<samtar@deploy1002> |
Started scap: Backport for [[gerrit:833830|Remove deployment-db08 (T318126)]] |
[production] |
| 19:33 |
<nokafor@deploy1002> |
Finished deploy [airflow-dags/analytics@ce20ecd]: (no justification provided) (duration: 00m 10s) |
[production] |
| 19:33 |
<nokafor@deploy1002> |
Started deploy [airflow-dags/analytics@ce20ecd]: (no justification provided) |
[production] |
| 19:25 |
<joal> |
Kill oozie daily cassandra loading jobs as we move them to airflow |
[analytics] |
| 19:18 |
<ottomata> |
kill aarora process 30421 run_embedding_training.sh on stat1005 |
[analytics] |
| 19:13 |
<joal> |
Deployed refinery for HQL patch (Njideka) |
[analytics] |
| 19:11 |
<ottomata> |
kill aarora process 14584 on stat1005 - using 2500% cpu |
[analytics] |
| 19:09 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 19:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 19:08 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 19:07 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 19:04 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: b8b2ebd3933cb891b62bb6aea01b2342c017cec8: Growth: Switch pilot wikis to structured mentor list (T310905) (duration: 03m 59s) |
[production] |
| 19:02 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 19:01 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 19:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 19:00 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |