|
2022-09-07
ยง
|
| 21:02 |
<samtar@deploy1002> |
Finished scap: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] (duration: 04m 36s) |
[production] |
| 21:02 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 21:02 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 21:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 21:01 |
<TheresNoTime> |
extending UTC late backport window |
[production] |
| 20:58 |
<samtar@deploy1002> |
samtar and zabe: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 20:58 |
<samtar@deploy1002> |
Started scap: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] |
[production] |
| 20:56 |
<samtar@deploy1002> |
Finished scap: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] (duration: 05m 54s) |
[production] |
| 20:56 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:55 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:55 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:54 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:51 |
<samtar@deploy1002> |
samtar and jdlrobson: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 20:50 |
<samtar@deploy1002> |
Started scap: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] |
[production] |
| 20:49 |
<samtar@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:830312|Wikidata has a wordmark (T315572)]] (duration: 03m 44s) |
[production] |
| 20:44 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:44 |
<samtar@deploy1002> |
Synchronized static/images/mobile/copyright/wikidata-en.svg: Config: [[gerrit:830312|Wikidata has a wordmark (T315572)]] (duration: 03m 45s) |
[production] |
| 20:43 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:43 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:42 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:37 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:36 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:36 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:35 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:35 |
<samtar@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:830600|Revert "Enable wgDiscussionToolsEnablePermalinksBackend on all wikis"]] (duration: 03m 42s) |
[production] |
| 20:21 |
<samtar@deploy1002> |
Finished scap: Backport for [[gerrit:830687|Enable wgDiscussionToolsEnablePermalinksBackend on all wikis (T315353)]] (duration: 06m 57s) |
[production] |
| 20:20 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:19 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:19 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:18 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:14 |
<samtar@deploy1002> |
samtar and matmarex: Backport for [[gerrit:830687|Enable wgDiscussionToolsEnablePermalinksBackend on all wikis (T315353)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 20:14 |
<samtar@deploy1002> |
Started scap: Backport for [[gerrit:830687|Enable wgDiscussionToolsEnablePermalinksBackend on all wikis (T315353)]] |
[production] |
| 20:12 |
<mutante> |
pcc-worker1003 - rm of /srv/jenkins/puppet-compiler/output/36713 and 37153 - /srv is back to 58% usage again |
[production] |
| 20:10 |
<mutante> |
integration.wikimedia.org - clicked to delete builds 36713 and 37153 because they were several GB in size |
[production] |
| 20:08 |
<TheresNoTime> |
running `extensions/WikimediaMaintenance/createExtensionTables.php discussiontools` on mwmaint1002 |
[production] |
| 20:08 |
<mutante> |
puppet compiler out of disk space, (pcc-worker1003): identified build 37153 as huge compared to others in the filesystem, then clicked to delete it via integration.wm.org web UI |
[production] |
| 19:26 |
<herron@cumin1001> |
END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-logging-eqiad cluster: Roll restart of jvm daemons. |
[production] |
| 18:34 |
<dduvall@deploy1002> |
Finished deploy [phabricator/deployment@a7616e6]: testing deployment to phab2001 (inactive) (duration: 00m 35s) |
[production] |
| 18:33 |
<dduvall@deploy1002> |
Started deploy [phabricator/deployment@a7616e6]: testing deployment to phab2001 (inactive) |
[production] |
| 18:26 |
<herron@cumin1001> |
START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-logging-eqiad cluster: Roll restart of jvm daemons. |
[production] |
| 18:25 |
<herron@cumin1001> |
END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-logging-codfw cluster: Roll restart of jvm daemons. |
[production] |
| 17:24 |
<herron@cumin1001> |
START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-logging-codfw cluster: Roll restart of jvm daemons. |
[production] |
| 16:56 |
<ejegg> |
restarted fundraising scheduled jobs |
[production] |
| 16:34 |
<ejegg> |
fundraising civicrm upgraded from 2fcd3bb4 to c1f0e041 |
[production] |
| 16:32 |
<xcollazo@deploy1002> |
Finished deploy [airflow-dags/platform_eng@9e4ed94]: Update platform_eng Airflow to latest (duration: 00m 10s) |
[production] |
| 16:31 |
<xcollazo@deploy1002> |
Started deploy [airflow-dags/platform_eng@9e4ed94]: Update platform_eng Airflow to latest |
[production] |
| 16:31 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) |
[production] |
| 16:30 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) |
[production] |
| 16:22 |
<moritzm> |
installing twisted security updates on bullseye |
[production] |
| 16:22 |
<cparle@deploy1002> |
Finished deploy [airflow-dags/platform_eng@9e4ed94]: (no justification provided) (duration: 00m 17s) |
[production] |