|
2023-03-24
ยง
|
| 23:58 |
<denisse@cumin1001> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "doc2002 - denisse@cumin1001 - T332819" |
[production] |
| 23:57 |
<denisse@cumin1001> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "doc2002 - denisse@cumin1001 - T332819" |
[production] |
| 23:50 |
<tzatziki> |
removing 1 file for legal compliance |
[production] |
| 21:08 |
<mutante> |
mwmaint1002 ferm rules for rsyncd_access from miscweb removed by puppet after I4fe17f397856361 which reverted a8af0339bde14018e8. manually deleted rsyncd config and stopped rsync service. complete noop on mwmaint2002 which is currently the active mwmaint server. T328907 |
[production] |
| 18:50 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@fc69bf4]: Make mw rev recommendation create start_date configurable (duration: 00m 13s) |
[production] |
| 18:50 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@fc69bf4]: Make mw rev recommendation create start_date configurable |
[production] |
| 18:30 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@220221d]: set start dates from transfer_to_es dags (duration: 00m 16s) |
[production] |
| 18:30 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@220221d]: set start dates from transfer_to_es dags |
[production] |
| 18:00 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@e3c41fb]: bump discolytics to 0.10.0, and add transfer_to_es dag (duration: 00m 20s) |
[production] |
| 18:00 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@e3c41fb]: bump discolytics to 0.10.0, and add transfer_to_es dag |
[production] |
| 17:55 |
<ebernhardson@deploy2002> |
Finished deploy [airflow-dags/search@822dfed]: dump discolytics to 0.10.0, and add transfer_to_es dag (duration: 00m 06s) |
[production] |
| 17:55 |
<ebernhardson@deploy2002> |
Started deploy [airflow-dags/search@822dfed]: dump discolytics to 0.10.0, and add transfer_to_es dag |
[production] |
| 15:39 |
<elukey@deploy2002> |
helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 15:39 |
<elukey@deploy2002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 15:37 |
<elukey@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/changeprop: sync |
[production] |
| 15:36 |
<elukey@deploy2002> |
helmfile [eqiad] START helmfile.d/services/changeprop: sync |
[production] |
| 15:35 |
<elukey@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/changeprop: sync |
[production] |
| 15:35 |
<elukey@deploy2002> |
helmfile [codfw] START helmfile.d/services/changeprop: sync |
[production] |
| 15:09 |
<elukey@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . |
[production] |
| 14:59 |
<elukey@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 14:43 |
<topranks> |
merged alertmanager rules for eventlogging checks being migrated from Icinga T309007 |
[analytics] |
| 14:24 |
<zabe> |
zabe@mwmaint2002:~$ mwscript extensions/Translate/scripts/moveTranslatableBundle.php --wiki wikimaniawiki "2024:Expressions of Interest" "Wikimania:Expressions of Interest" "Zabe" --reason "per request [[:phab:T332917|T332917]]" # T332917 |
[production] |
| 14:13 |
<wm-bot2> |
cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by arturo@endurance |
[tools] |
| 11:45 |
<mvernon@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ms-be2067.codfw.wmnet |
[production] |
| 11:44 |
<mvernon@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ms-be2067.codfw.wmnet |
[production] |
| 11:01 |
<elukey@deploy2002> |
helmfile [staging] DONE helmfile.d/services/changeprop: sync |
[production] |
| 11:01 |
<elukey@deploy2002> |
helmfile [staging] START helmfile.d/services/changeprop: sync |
[production] |
| 10:55 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 21 days, 0:00:00 on krb2002.codfw.wmnet with reason: Non-functional, WIP for Bullseye update |
[production] |
| 10:55 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 21 days, 0:00:00 on krb2002.codfw.wmnet with reason: Non-functional, WIP for Bullseye update |
[production] |
| 10:35 |
<elukey@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . |
[production] |
| 10:00 |
<marostegui> |
Upgrade db1204 to mariadb 10.6 T330861 |
[production] |
| 08:57 |
<hashar> |
Fixed up Gerrit > GitHub replication which broke at 5:00 UTC by updating the Github RSA ssh host key T332972 |
[production] |
| 05:37 |
<hashar> |
gerrit: refreshed ssh host key for `github.com` |
[production] |
| 05:34 |
<wm-bot> |
<legoktm> Updated from ddfe4f5 to 974657a |
[tools.streaks] |
| 05:28 |
<hashar> |
Restarted Gerrit |
[production] |
| 05:26 |
<hashar> |
Stopping Gerrit |
[production] |
| 05:26 |
<hashar@deploy2002> |
Finished deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) (duration: 00m 10s) |
[production] |
| 05:25 |
<hashar@deploy2002> |
Started deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) |
[production] |
| 05:22 |
<hashar> |
Restarting gerrit replica on gerrit2002.wikimedia.org |
[production] |
| 05:21 |
<hashar@deploy2002> |
Finished deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) (duration: 00m 07s) |
[production] |
| 05:20 |
<hashar@deploy2002> |
Started deploy [gerrit/gerrit@c1cbda4]: Update js plugins for EarlyWarning bot (T330850) and displaying Zuul status on changes (T241068) |
[production] |
| 05:17 |
<hashar> |
Restarting Gerrit for deploying plugins updates |
[production] |
| 05:17 |
<wm-bot> |
<legoktm> Updated from f2762c3 to f6654d0 |
[tools.steve-adder] |
| 05:10 |
<ejegg> |
Standalone SmashPig upgraded from 3b84e4cb to 50139e82 |
[production] |
| 05:07 |
<wm-bot> |
<legoktm> Updated from 66a7d6e to bc96bfd |
[tools.rust-hello-world] |
| 05:04 |
<wm-bot> |
<legoktm> Updated from 937b489 to 2a6ec37 |
[tools.rfa-voting-history] |
| 05:04 |
<ejegg> |
payments-wiki upgraded from 4d0c90b4 to 4b0a71fa |
[production] |
| 04:46 |
<wm-bot> |
<legoktm> Updated from 2fff41a to 19b91bd |
[tools.prosesize] |
| 04:32 |
<wm-bot> |
<legoktm> Updated from 164111f to 51e89bc |
[tools.apt-browser] |
| 00:38 |
<gmodena@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |