1301-1350 of 10000 results (32ms)
2024-12-04 ยง
13:50 <jelto@cumin1002> START - Cookbook sre.dns.netbox [production]
13:50 <jayme@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host mw[2445-2447].codfw.wmnet [production]
13:50 <jelto@cumin1002> START - Cookbook sre.hosts.rename from kubernetes1024 to wikikube-worker1037 [production]
13:49 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from kubernetes1023 to wikikube-worker1036 [production]
13:48 <jelto@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1036 [production]
13:47 <jelto@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1036 [production]
13:47 <jelto@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:47 <jelto@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1023 to wikikube-worker1036 - jelto@cumin1002" [production]
13:47 <jelto@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1023 to wikikube-worker1036 - jelto@cumin1002" [production]
13:47 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1100150|Ensure IP reveal buttons are not shown on Special:MassGlobalBlock (T124607)]] [production]
13:42 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1100442|Stats: Move StatsFactory flush into emitBufferedStats (T380609)]], [[gerrit:1100434|Fix handling of 'last-checked' as 'never' in scanFilesInScanTable.php (T355169)]], [[gerrit:1100430|Fix handling of 'last-checked' as 'never' in scanFilesInScanTable.php (T355169)]], [[gerrit:1100449|Revert "Stats: Move StatsFactory flush into emitBufferedSt [production]
13:41 <jayme@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2016,2171-2172].codfw.wmnet [production]
13:41 <jayme@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2016,2171-2172].codfw.wmnet [production]
13:39 <sstefanova@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
13:39 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
13:39 <jelto@cumin1002> START - Cookbook sre.dns.netbox [production]
13:39 <jelto@cumin1002> START - Cookbook sre.hosts.rename from kubernetes1023 to wikikube-worker1036 [production]
13:39 <hashar> Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/1094459 : Add CampaignEvents and WikimediaCampaignEvents to the gate - T380595 [releng]
13:38 <sstefanova@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
13:37 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
13:35 <jayme@cumin2002> START - Cookbook sre.hosts.reimage for host wikikube-worker2015.codfw.wmnet with OS bookworm [production]
13:35 <jayme@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2015.codfw.wmnet with OS bookworm [production]
13:33 <dreamyjazz@deploy2002> dreamyjazz: Continuing with sync [production]
13:33 <dreamyjazz@deploy2002> dreamyjazz: Backport for [[gerrit:1100442|Stats: Move StatsFactory flush into emitBufferedStats (T380609)]], [[gerrit:1100434|Fix handling of 'last-checked' as 'never' in scanFilesInScanTable.php (T355169)]], [[gerrit:1100430|Fix handling of 'last-checked' as 'never' in scanFilesInScanTable.php (T355169)]], [[gerrit:1100449|Revert "Stats: Move StatsFactory flush into emitBufferedStats"]] synced [production]
13:31 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubernetes[1023-1024].eqiad.wmnet [production]
13:30 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host kubernetes[1023-1024].eqiad.wmnet [production]
13:29 <sstefanova@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [toolsbeta]
13:28 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1100442|Stats: Move StatsFactory flush into emitBufferedStats (T380609)]], [[gerrit:1100434|Fix handling of 'last-checked' as 'never' in scanFilesInScanTable.php (T355169)]], [[gerrit:1100430|Fix handling of 'last-checked' as 'never' in scanFilesInScanTable.php (T355169)]], [[gerrit:1100449|Revert "Stats: Move StatsFactory flush into emitBufferedSta [production]
13:22 <sstefanova@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
13:20 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet with reason: Alter table [production]
13:20 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet with reason: Alter table [production]
13:19 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on clouddb1020.eqiad.wmnet with reason: Alter table [production]
13:19 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on clouddb1020.eqiad.wmnet with reason: Alter table [production]
13:19 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on clouddb1016.eqiad.wmnet with reason: Alter table [production]
13:19 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on clouddb1016.eqiad.wmnet with reason: Alter table [production]
13:19 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1154.eqiad.wmnet with reason: Alter table [production]
13:18 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on db1154.eqiad.wmnet with reason: Alter table [production]
13:12 <dani@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
13:12 <dani@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
13:12 <dani@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
13:12 <dani@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
13:12 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
13:12 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
13:09 <dani@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
13:09 <dani@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
13:09 <dani@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
13:09 <dani@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
13:09 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
13:09 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
13:06 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1172 (T371742)', diff saved to https://phabricator.wikimedia.org/P71537 and previous config saved to /var/cache/conftool/dbconfig/20241204-130614-ladsgroup.json [production]