|
2023-12-23
§
|
| 20:22 |
<_joe_> |
downgraded vopsbot on alert1001, hopefully should not keep panicing in this unexpected situation |
[production] |
| 18:24 |
<taavi@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component builds-api |
[tools] |
| 18:24 |
<taavi@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component builds-api |
[tools] |
| 17:08 |
<wm-bot> |
<root> restart to fix 5xx errors |
[tools.sal] |
| 15:40 |
<taavi> |
fix date-time on mw2448 (which thought it is the year 2098) by manually setting it once and then restarting systemd-timesyncd.service after bios was reset in T353679 |
[production] |
| 09:55 |
<hashar> |
gerrit: deleted repository `test/🤖` | T353977 |
[releng] |
| 01:19 |
<rzl@deploy2002> |
helmfile [codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 01:19 |
<rzl@deploy2002> |
helmfile [codfw] START helmfile.d/admin 'apply'. |
[production] |
|
2023-12-22
§
|
| 21:38 |
<mforns> |
re-ran the Airflow DAG cassandra_load_unique_devices_daily for 2023-12-14 |
[analytics] |
| 21:37 |
<mforns> |
re-ran the Airflow DAG druid_load_unique_devices_per_domain_daily for 2023-12-14 |
[analytics] |
| 21:37 |
<mforns> |
re-ran the Airflow DAG druid_load_unique_devices_per_project_family_daily for 2023-12-14 |
[analytics] |
| 21:30 |
<mforns> |
re-ran the Airflow DAG unique_devices_per_project_family_daily for 2023-12-14 |
[analytics] |
| 21:29 |
<mforns> |
re-ran the Airflow DAG unique_devices_per_domain_daily for 2023-12-14 |
[analytics] |
| 21:26 |
<mforns> |
re-ran Airflow job anomaly_detection_traffic_distribution_daily from 2023-12-14 to 2023-12-21 |
[analytics] |
| 17:28 |
<krinkle@deploy2002> |
Synchronized php-1.42.0-wmf.10/includes/skins/Skin.php: Ice6d6cfb442e4b3edb7f3002799780c76d7e0b0e (duration: 06m 25s) |
[production] |
| 15:16 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@5f2756a]: (no justification provided) (duration: 17m 36s) |
[production] |
| 14:58 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@5f2756a]: (no justification provided) |
[production] |
| 14:57 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@f0c9f9f]: (no justification provided) (duration: 09m 32s) |
[production] |
| 14:48 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@f0c9f9f]: (no justification provided) |
[production] |
| 14:01 |
<jgiannelos@deploy2002> |
Finished deploy [restbase/deploy@4f56fff]: (no justification provided) (duration: 16m 57s) |
[production] |
| 13:45 |
<reedy@deploy2002> |
Finished scap: T353920 (duration: 08m 02s) |
[production] |
| 13:44 |
<jgiannelos@deploy2002> |
Started deploy [restbase/deploy@4f56fff]: (no justification provided) |
[production] |
| 13:37 |
<reedy@deploy2002> |
Started scap: T353920 |
[production] |
| 11:31 |
<vgutierrez> |
upload golang-github-intel-go-cpuid_0.0~git20210602.5747e5c-2+deb12u1 to apt.wm.o (bookworm) |
[production] |
| 10:42 |
<isaranto@deploy2002> |
helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . |
[production] |
| 10:42 |
<isaranto@deploy2002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . |
[production] |
| 10:39 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . |
[production] |
| 09:57 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'readability' for release 'main' . |
[production] |
| 00:23 |
<thcipriani> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/985058 |
[releng] |
|
2023-12-21
§
|
| 21:42 |
<wfan> |
payment-wiki revision 1c96980a -> 3b281d10 |
[production] |
| 19:31 |
<reedy@deploy2002> |
Synchronized wmf-config/CommonSettings.php: T346919 (duration: 06m 26s) |
[production] |
| 19:14 |
<dancy@deploy2002> |
rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.10 refs T350086 |
[production] |
| 18:42 |
<thcipriani> |
docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/984867 {{done}} |
[releng] |
| 18:39 |
<mutante> |
releases1003 - sudo chmod -R g+w /srv/org/wikimedia/releases/mediawiki/1.* |
[production] |
| 18:10 |
<MacFan4000> |
full restart of bot + xmlrcs following disconnection |
[wm-bot] |
| 17:54 |
<thcipriani> |
Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/984867 (cc dancy) |
[releng] |
| 17:26 |
<mutante> |
mirror1001 - when syncing tails mirror - @ERROR: max connections (23) reached -- try again later |
[production] |
| 17:23 |
<mutante> |
[mirror1001:~] $ sudo systemctl start update-tails-mirror |
[production] |
| 17:22 |
<fnegri@cloudcumin1001> |
END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'fnegri' in role 'member' |
[tf-infra-test] |
| 17:22 |
<fnegri@cloudcumin1001> |
START - Cookbook wmcs.vps.add_user_to_project for user 'fnegri' in role 'member' |
[tf-infra-test] |
| 17:04 |
<cgoubert@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 17:03 |
<cgoubert@deploy2002> |
helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 17:03 |
<cgoubert@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 17:03 |
<cgoubert@deploy2002> |
helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 17:02 |
<cgoubert@deploy2002> |
helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 17:02 |
<cgoubert@deploy2002> |
helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply |
[production] |
| 16:51 |
<dhinus> |
puppet node deactivate cloudvirt1063.eqiad.wmnet T353406 |
[admin] |
| 16:27 |
<akosiaris@deploy2002> |
helmfile [staging] DONE helmfile.d/services/changeprop: apply |
[production] |
| 16:27 |
<akosiaris@deploy2002> |
helmfile [staging] START helmfile.d/services/changeprop: apply |
[production] |
| 16:26 |
<akosiaris@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/changeprop: apply |
[production] |