|
2023-03-24
§
|
| 23:58 |
<denisse@cumin1001> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "doc2002 - denisse@cumin1001 - T332819" |
[production] |
| 23:57 |
<denisse@cumin1001> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "doc2002 - denisse@cumin1001 - T332819" |
[production] |
| 23:50 |
<tzatziki> |
removing 1 file for legal compliance |
[production] |
| 21:08 |
<mutante> |
mwmaint1002 ferm rules for rsyncd_access from miscweb removed by puppet after I4fe17f397856361 which reverted a8af0339bde14018e8. manually deleted rsyncd config and stopped rsync service. complete noop on mwmaint2002 which is currently the active mwmaint server. T328907 |
[production] |
| 18:50 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@fc69bf4]: Make mw rev recommendation create start_date configurable (duration: 00m 13s) |
[production] |
| 18:50 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@fc69bf4]: Make mw rev recommendation create start_date configurable |
[production] |
| 18:30 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@220221d]: set start dates from transfer_to_es dags (duration: 00m 16s) |
[production] |
| 18:30 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@220221d]: set start dates from transfer_to_es dags |
[production] |
| 18:00 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@e3c41fb]: bump discolytics to 0.10.0, and add transfer_to_es dag (duration: 00m 20s) |
[production] |
| 18:00 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@e3c41fb]: bump discolytics to 0.10.0, and add transfer_to_es dag |
[production] |
| 17:55 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@822dfed]: dump discolytics to 0.10.0, and add transfer_to_es dag (duration: 00m 06s) |
[production] |
| 17:55 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@822dfed]: dump discolytics to 0.10.0, and add transfer_to_es dag |
[production] |
| 15:39 |
<elukey@deploy2002> |
helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 15:39 |
<elukey@deploy2002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 15:37 |
<elukey@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/changeprop: sync |
[production] |
| 15:36 |
<elukey@deploy2002> |
helmfile [eqiad] START helmfile.d/services/changeprop: sync |
[production] |
| 15:35 |
<elukey@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/changeprop: sync |
[production] |
| 15:35 |
<elukey@deploy2002> |
helmfile [codfw] START helmfile.d/services/changeprop: sync |
[production] |
| 15:09 |
<elukey@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . |
[production] |
| 14:59 |
<elukey@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 14:24 |
<zabe> |
zabe@mwmaint2002:~$ mwscript extensions/Translate/scripts/moveTranslatableBundle.php --wiki wikimaniawiki "2024:Expressions of Interest" "Wikimania:Expressions of Interest" "Zabe" --reason "per request [[:phab:T332917|T332917]]" # T332917 |
[production] |
| 11:45 |
<mvernon@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ms-be2067.codfw.wmnet |
[production] |
| 11:44 |
<mvernon@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ms-be2067.codfw.wmnet |
[production] |
| 11:01 |
<elukey@deploy2002> |
helmfile [staging] DONE helmfile.d/services/changeprop: sync |
[production] |
| 11:01 |
<elukey@deploy2002> |
helmfile [staging] START helmfile.d/services/changeprop: sync |
[production] |
| 10:55 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 21 days, 0:00:00 on krb2002.codfw.wmnet with reason: Non-functional, WIP for Bullseye update |
[production] |
| 10:55 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 21 days, 0:00:00 on krb2002.codfw.wmnet with reason: Non-functional, WIP for Bullseye update |
[production] |
| 10:35 |
<elukey@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 10:00 |
<marostegui> |
Upgrade db1204 to mariadb 10.6 T330861 |
[production] |
| 08:57 |
<hashar> |
Fixed up Gerrit > GitHub replication which broke at 5:00 UTC by updating the Github RSA ssh host key T332972 |
[production] |
| 05:37 |
<hashar> |
gerrit: refreshed ssh host key for `github.com` |
[production] |
| 05:28 |
<hashar> |
Restarted Gerrit |
[production] |
| 05:26 |
<hashar> |
Stopping Gerrit |
[production] |
| 05:26 |
<hashar@deploy2002> |
Finished deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) (duration: 00m 10s) |
[production] |
| 05:25 |
<hashar@deploy2002> |
Started deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) |
[production] |
| 05:22 |
<hashar> |
Restarting gerrit replica on gerrit2002.wikimedia.org |
[production] |
| 05:21 |
<hashar@deploy2002> |
Finished deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) (duration: 00m 07s) |
[production] |
| 05:20 |
<hashar@deploy2002> |
Started deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) |
[production] |
| 05:17 |
<hashar> |
Restarting Gerrit for deploying plugins updates |
[production] |
| 05:10 |
<ejegg> |
Standalone SmashPig upgraded from 3b84e4cb to 50139e82 |
[production] |
| 05:04 |
<ejegg> |
payments-wiki upgraded from 4d0c90b4 to 4b0a71fa |
[production] |
| 00:38 |
<gmodena@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 00:38 |
<gmodena@deploy1002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 00:32 |
<gmodena@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 00:32 |
<gmodena@deploy1002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |