201-250 of 10000 results (32ms)
2024-12-03 ยง
18:56 <bking@cumin2002> START - Cookbook sre.wdqs.data-transfer (T376150, initialize wdqs internal main tier) xfer scholarly_articles from wdqs2021.codfw.wmnet -> wdqs2018.codfw.wmnet, repooling source-only afterwards [production]
18:49 <ryankemper@deploy2002> Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host (duration: 00m 14s) [production]
18:49 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host [production]
18:47 <ryankemper@deploy2002> Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host (duration: 00m 14s) [production]
18:47 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host [production]
18:43 <ryankemper@deploy2002> Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host (duration: 03m 31s) [production]
18:40 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host [production]
18:39 <ryankemper@deploy2002> Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host (duration: 00m 11s) [production]
18:39 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host [production]
18:39 <ryankemper@deploy2002> Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host (duration: 00m 11s) [production]
18:39 <ryankemper@deploy2002> Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host [production]
18:35 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1034-1035].eqiad.wmnet [production]
18:35 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1034-1035].eqiad.wmnet [production]
18:25 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:25 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:23 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:23 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:23 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:23 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:22 <jelto> homer 'cr*eqiad*' commit 'T377876' [production]
18:14 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:14 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:11 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1035.eqiad.wmnet with OS bookworm [production]
18:10 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:10 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:09 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:09 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:09 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:07 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:07 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:07 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:07 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:06 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:04 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:03 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
18:01 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]
18:00 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1091.eqiad.wmnet with OS bullseye [production]
18:00 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
17:59 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
17:57 <hnowlan@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
17:57 <hnowlan@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
17:57 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
17:56 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
17:52 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1035.eqiad.wmnet with reason: host reimage [production]
17:50 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on wdqs2026.codfw.wmnet with reason: T376150 [production]
17:50 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 4:00:00 on wdqs2026.codfw.wmnet with reason: T376150 [production]
17:48 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1035.eqiad.wmnet with reason: host reimage [production]
17:47 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: dc=magru,service=cdn,name=cp7001.magru.wmnet [production]
17:46 <brett> Removing RSA certificate support from haproxy/cp (T370837) [production]
17:38 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api [toolsbeta]