4301-4350 of 10000 results (56ms)
2024-12-04 ยง
14:50 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2445.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:49 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1025.eqiad.wmnet with reason: host reimage [production]
14:49 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1035.eqiad.wmnet}' (T380731) [admin]
14:48 <samtar@deploy2002> Started scap sync-world: Backport for [[gerrit:1090502|Add new namespaces to hsb wiktionary (T373634)]] [production]
14:48 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1035.eqiad.wmnet' (T380893) [admin]
14:47 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-api [toolsbeta]
14:47 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1037.eqiad.wmnet with OS bookworm [production]
14:46 <sstefanova@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [tools]
14:46 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1172 (T371742)', diff saved to https://phabricator.wikimedia.org/P71540 and previous config saved to /var/cache/conftool/dbconfig/20241204-144651-ladsgroup.json [production]
14:46 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1036.eqiad.wmnet with OS bookworm [production]
14:46 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1025.eqiad.wmnet with reason: host reimage [production]
14:45 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1035.eqiad.wmnet' (T380893) [admin]
14:45 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [tools]
14:31 <Lucas_WMDE> UTC afternoon backport+config window done [production]
14:29 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1100352|Translate: Enable message group subscription for 6 wikis (T372386)]] (duration: 18m 12s) [production]
14:27 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1036.eqiad.wmnet with reason: host reimage [production]
14:26 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-api [toolsbeta]
14:23 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1036.eqiad.wmnet with reason: host reimage [production]
14:22 <lucaswerkmeister-wmde@deploy2002> abi, lucaswerkmeister-wmde: Continuing with sync [production]
14:20 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [toolsbeta]
14:20 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-api [toolsbeta]
14:20 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-api [toolsbeta]
14:20 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-api [toolsbeta]
14:19 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host wdqs1025.eqiad.wmnet with OS bullseye [production]
14:18 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2015.codfw.wmnet with OS bookworm [production]
14:17 <lucaswerkmeister-wmde@deploy2002> abi, lucaswerkmeister-wmde: Backport for [[gerrit:1100352|Translate: Enable message group subscription for 6 wikis (T372386)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:14 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
14:13 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api [toolsbeta]
14:11 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1100352|Translate: Enable message group subscription for 6 wikis (T372386)]] [production]
14:10 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
14:07 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1036.eqiad.wmnet with OS bookworm [production]
14:05 <jelto@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1036.eqiad.wmnet wikikube-worker1037.eqiad.wmnet on all recursors [production]
14:05 <jelto@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker1036.eqiad.wmnet wikikube-worker1037.eqiad.wmnet on all recursors [production]
14:01 <jayme@cumin2002> START - Cookbook sre.hosts.provision for host mw2446.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:01 <jayme@cumin2002> START - Cookbook sre.hosts.provision for host mw2447.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:01 <jayme@cumin2002> START - Cookbook sre.hosts.provision for host mw2445.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:00 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host es1045.eqiad.wmnet with OS bookworm [production]
14:00 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host es1044.eqiad.wmnet with OS bookworm [production]
14:00 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host es1043.eqiad.wmnet with OS bookworm [production]
14:00 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1100150|Ensure IP reveal buttons are not shown on Special:MassGlobalBlock (T124607)]] (duration: 13m 08s) [production]
13:59 <sstefanova@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-api [toolsbeta]
13:59 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-api [toolsbeta]
13:58 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2015.codfw.wmnet with reason: host reimage [production]
13:58 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on mw[2445-2447].codfw.wmnet with reason: reimage [production]
13:57 <jayme@cumin2002> START - Cookbook sre.hosts.downtime for 4:00:00 on mw[2445-2447].codfw.wmnet with reason: reimage [production]
13:56 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from kubernetes1024 to wikikube-worker1037 [production]
13:55 <jelto@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1037 [production]
13:54 <jayme@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2015.codfw.wmnet with reason: host reimage [production]
13:54 <jelto@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1037 [production]
13:54 <jelto@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]