451-500 of 10000 results (28ms)
2024-10-07 §
10:34 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1233 (re)pooling @ 50%: T374215', diff saved to https://phabricator.wikimedia.org/P69482 and previous config saved to /var/cache/conftool/dbconfig/20241007-103420-arnaudb.json [production]
10:19 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1233 (re)pooling @ 25%: T374215', diff saved to https://phabricator.wikimedia.org/P69481 and previous config saved to /var/cache/conftool/dbconfig/20241007-101914-arnaudb.json [production]
10:17 <vgutierrez> uploaded golang-github-cloudflare-ipvs 0.10.2 to apt.wm.o (bookworm-wikimedia) - T376600 [production]
10:13 <moritzm> installing Linux 6.1.112 on Bookworm systems [production]
10:11 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
10:11 <jelto@cumin1002> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: test I946dd0b73b6be2d6b8093f03550f78d76188b92b with dummy upgrade [production]
10:11 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
10:10 <jelto@cumin1002> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: test I946dd0b73b6be2d6b8093f03550f78d76188b92b with dummy upgrade [production]
10:04 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1233 (re)pooling @ 10%: T374215', diff saved to https://phabricator.wikimedia.org/P69480 and previous config saved to /var/cache/conftool/dbconfig/20241007-100410-arnaudb.json [production]
09:59 <vgutierrez> uploaded golang-github-flyingmutant-rapid 1.1.0 to apt.wm.o (bookworm-wikimedia) - T376600 [production]
09:49 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1233 (re)pooling @ 5%: T374215', diff saved to https://phabricator.wikimedia.org/P69478 and previous config saved to /var/cache/conftool/dbconfig/20241007-094904-arnaudb.json [production]
09:34 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1233 (re)pooling @ 2%: T374215', diff saved to https://phabricator.wikimedia.org/P69477 and previous config saved to /var/cache/conftool/dbconfig/20241007-093359-arnaudb.json [production]
09:30 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1246.eqiad.wmnet with reason: maintenance [production]
09:30 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1246.eqiad.wmnet with reason: maintenance [production]
09:27 <arnaudb@cumin1002> dbctl commit (dc=all): 'missing commit', diff saved to https://phabricator.wikimedia.org/P69476 and previous config saved to /var/cache/conftool/dbconfig/20241007-092714-arnaudb.json [production]
09:19 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1246 (re)pooling @ 1%: T374215', diff saved to https://phabricator.wikimedia.org/P69474 and previous config saved to /var/cache/conftool/dbconfig/20241007-091953-arnaudb.json [production]
09:18 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1233 (re)pooling @ 1%: T374215', diff saved to https://phabricator.wikimedia.org/P69473 and previous config saved to /var/cache/conftool/dbconfig/20241007-091854-arnaudb.json [production]
09:13 <arnaudb@cumin1002> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1233.eqiad.wmnet onto db1246.eqiad.wmnet [production]
08:37 <aqu@deploy2002> Finished deploy [airflow-dags/analytics@1699d34]: Refine staging fixes [airflow-dags@1699d34f] (duration: 04m 43s) [production]
08:32 <aqu@deploy2002> Started deploy [airflow-dags/analytics@1699d34]: Refine staging fixes [airflow-dags@1699d34f] [production]
08:24 <aqu@deploy2002> Finished deploy [airflow-dags/analytics_test@4b69f50]: Stage Refine fixes on test cluster [airflow-dags@4b69f503] (duration: 00m 13s) [production]
08:24 <aqu@deploy2002> Started deploy [airflow-dags/analytics_test@4b69f50]: Stage Refine fixes on test cluster [airflow-dags@4b69f503] [production]
08:02 <aqu@deploy2002> Finished deploy [airflow-dags/analytics_test@4b69f50]: Stage Refine fixes on test cluster [airflow-dags@4b69f503] (duration: 00m 18s) [production]
08:02 <jelto@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikidata-query-gui: apply [production]
08:02 <aqu@deploy2002> Started deploy [airflow-dags/analytics_test@4b69f50]: Stage Refine fixes on test cluster [airflow-dags@4b69f503] [production]
08:02 <jelto@deploy2002> helmfile [codfw] START helmfile.d/services/wikidata-query-gui: apply [production]
08:01 <jelto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply [production]
08:01 <jelto@deploy2002> helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply [production]
08:01 <wmbot~fnegri@tools-bastion-13> webservice restart [tools.sal]
08:00 <aborrero@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudgw1002.eqiad.wmnet [production]
07:57 <aborrero@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudgw1002.eqiad.wmnet [production]
07:56 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone of db1233.eqiad.wmnet onto db1246.eqiad.wmnet [production]
07:56 <arnaudb@cumin1002> dbctl commit (dc=all): 'T374215 db1233 depool as clone source for db1246', diff saved to https://phabricator.wikimedia.org/P69471 and previous config saved to /var/cache/conftool/dbconfig/20241007-075611-arnaudb.json [production]
07:56 <hashar> UTC morning backport window completed [production]
07:54 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077392|logos: Sync config.yaml and logos.php (T374430)]], [[gerrit:1077400|hawiki: Add temporary logo (T376049)]] (duration: 11m 19s) [production]
07:49 <hashar@deploy2002> ammarpad, hashar: Continuing with sync [production]
07:45 <hashar@deploy2002> ammarpad, hashar: Backport for [[gerrit:1077392|logos: Sync config.yaml and logos.php (T374430)]], [[gerrit:1077400|hawiki: Add temporary logo (T376049)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:43 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1077392|logos: Sync config.yaml and logos.php (T374430)]], [[gerrit:1077400|hawiki: Add temporary logo (T376049)]] [production]
07:42 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077422|Revert "wikimaniawiki: Update logos to 2024"]] (duration: 21m 40s) [production]
07:04 <jelto@deploy2002> helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply [production]
07:04 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 64315 [production]
07:04 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'email' for AS: 64315 [production]
07:04 <jelto@deploy2002> helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply [production]
2024-10-06 §
22:59 <eileen> civicrm upgraded from 45855ff4 to f2095695 [production]
20:51 <James_F> Docker: Re-building PHP images with composer v2.8.1, for T376409, and PHP 8.1 images with PHP 8.1.30-1+wmf11u1 [releng]
2024-10-05 §
19:43 <isaranto@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
16:45 <hnowlan@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:41 <hnowlan@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:40 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
16:37 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]