751-800 of 10000 results (23ms)
2024-09-18 ยง
11:52 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
11:51 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
11:51 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
11:50 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
11:50 <dreamyjazz@deploy1003> dreamyjazz: Continuing with sync [production]
11:49 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
11:48 <dreamyjazz@deploy1003> dreamyjazz: Backport for [[gerrit:1073755|Hooks: Re-order checks to verify that request user is same as Special:Contributions user (T375061)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
11:47 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'aborrero' in role 'member' [cloudinfra]
11:47 <aborrero@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'aborrero' in role 'member' [cloudinfra]
11:46 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073755|Hooks: Re-order checks to verify that request user is same as Special:Contributions user (T375061)]] [production]
11:43 <XioNoX> update pfw3-codfw dhcp-relay target 0 T375011 [production]
11:43 <tchin@deploy1003> Finished deploy [analytics/refinery@bc0be94] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@bc0be94a] (duration: 03m 57s) [production]
11:43 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/46 [admin]
11:42 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/46 [admin]
11:39 <tchin@deploy1003> Started deploy [analytics/refinery@bc0be94] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@bc0be94a] [production]
11:39 <tchin@deploy1003> Finished deploy [analytics/refinery@bc0be94] (thin): Regular analytics weekly train THIN [analytics/refinery@bc0be94a] (duration: 05m 50s) [production]
11:35 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/46 [admin]
11:35 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/46 [admin]
11:33 <tchin@deploy1003> Started deploy [analytics/refinery@bc0be94] (thin): Regular analytics weekly train THIN [analytics/refinery@bc0be94a] [production]
11:32 <tchin@deploy1003> Finished deploy [analytics/refinery@bc0be94]: Regular analytics weekly train [analytics/refinery@bc0be94a] (duration: 09m 06s) [production]
11:30 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/46 [admin]
11:30 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/46 [admin]
11:23 <tchin@deploy1003> Started deploy [analytics/refinery@bc0be94]: Regular analytics weekly train [analytics/refinery@bc0be94a] [production]
11:23 <tchin> Deploying refinery [production]
11:23 <tchin> Deploying refinery [analytics]
11:16 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
11:15 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
10:56 <wmbot~jeanfred@tools-sgebastion-10> Deploy 7f7efe8 [tools.wikiloves]
10:54 <stevemunene@cumin1002> START - Cookbook sre.hosts.reimage for host an-worker1177.eqiad.wmnet with OS bullseye [production]
10:25 <stevemunene@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1176.eqiad.wmnet with OS bullseye [production]
10:20 <elukey> restart poolcounterd on poolcounter2003 (not serving any traffic atm, tried to clear old/stale conns) [production]
10:14 <elukey@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073427|Swap poolcounter2004 with poolcounter2006 (T332015)]] (duration: 07m 08s) [production]
10:09 <elukey@deploy1003> elukey: Continuing with sync [production]
10:09 <elukey@deploy1003> elukey: Backport for [[gerrit:1073427|Swap poolcounter2004 with poolcounter2006 (T332015)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
10:07 <elukey@deploy1003> Started scap sync-world: Backport for [[gerrit:1073427|Swap poolcounter2004 with poolcounter2006 (T332015)]] [production]
09:26 <tappof@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host centrallog2002.codfw.wmnet [production]
09:11 <stevemunene@cumin1002> START - Cookbook sre.hosts.reimage for host an-worker1176.eqiad.wmnet with OS bullseye [production]
09:11 <tappof@cumin2002> START - Cookbook sre.hosts.reboot-single for host centrallog2002.codfw.wmnet [production]
09:10 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
09:01 <moritzm> drain ganeti2026 T373104 [production]
08:59 <dcaro@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
08:52 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
08:41 <tappof> centrallog2002 upgrade to bookworm in progress https://phabricator.wikimedia.org/T353912 [production]
08:40 <dcaro@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
08:39 <dcaro> restarted rabbitmq-server on all cloudrabbits [admin]
08:36 <hashar> Updating Quibble Jenkins jobs to quibble 1.10.0 | https://gerrit.wikimedia.org/r/c/integration/config/+/1073542 | T365976 | T50217 [releng]
08:32 <elukey> install openjdk-17-jdk on puppetserver1002 to get some useful tools like jmap - T373527 [production]
08:30 <jnuche@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.23 refs T373642 [production]
08:27 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
08:25 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]