2351-2400 of 10000 results (34ms)
2025-09-03 ยง
12:15 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2165 (T401906)', diff saved to https://phabricator.wikimedia.org/P82475 and previous config saved to /var/cache/conftool/dbconfig/20250903-121538-fceratto.json [production]
12:15 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2165.codfw.wmnet with reason: Maintenance [production]
12:15 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T401906)', diff saved to https://phabricator.wikimedia.org/P82474 and previous config saved to /var/cache/conftool/dbconfig/20250903-121514-fceratto.json [production]
12:04 <Amir1> dropping objectcache table in group0 (T397367) [production]
12:00 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers [tools]
12:00 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P82473 and previous config saved to /var/cache/conftool/dbconfig/20250903-120007-fceratto.json [production]
11:58 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers [toolsbeta]
11:46 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1234.eqiad.wmnet with OS bullseye [production]
11:45 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P82472 and previous config saved to /var/cache/conftool/dbconfig/20250903-114500-fceratto.json [production]
11:40 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers [toolsbeta]
11:39 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [tools]
11:37 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [tools]
11:34 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [toolsbeta]
11:32 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
11:29 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T401906)', diff saved to https://phabricator.wikimedia.org/P82471 and previous config saved to /var/cache/conftool/dbconfig/20250903-112952-fceratto.json [production]
11:29 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1234.eqiad.wmnet with reason: host reimage [production]
11:28 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2164 (T401906)', diff saved to https://phabricator.wikimedia.org/P82470 and previous config saved to /var/cache/conftool/dbconfig/20250903-112842-fceratto.json [production]
11:28 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2164.codfw.wmnet with reason: Maintenance [production]
11:28 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T401906)', diff saved to https://phabricator.wikimedia.org/P82469 and previous config saved to /var/cache/conftool/dbconfig/20250903-112820-fceratto.json [production]
11:25 <mvolz@deploy1003> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
11:25 <btullis@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1234.eqiad.wmnet with reason: host reimage [production]
11:25 <mvolz@deploy1003> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
11:24 <mvolz@deploy1003> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
11:24 <mvolz@deploy1003> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
11:21 <mvolz@deploy1003> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
11:21 <mvolz@deploy1003> helmfile [staging] START helmfile.d/services/citoid: apply [production]
11:13 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P82468 and previous config saved to /var/cache/conftool/dbconfig/20250903-111313-fceratto.json [production]
11:12 <mvolz@deploy1003> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
11:12 <mvolz@deploy1003> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
11:10 <mvolz@deploy1003> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
11:10 <mvolz@deploy1003> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
11:08 <mvolz@deploy1003> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
11:08 <mvolz@deploy1003> helmfile [staging] START helmfile.d/services/citoid: apply [production]
11:05 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:05 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
11:01 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1234.eqiad.wmnet with OS bullseye [production]
11:01 <btullis@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host an-worker1234.eqiad.wmnet with OS bullseye [production]
10:58 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P82467 and previous config saved to /var/cache/conftool/dbconfig/20250903-105805-fceratto.json [production]
10:42 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T401906)', diff saved to https://phabricator.wikimedia.org/P82466 and previous config saved to /var/cache/conftool/dbconfig/20250903-104257-fceratto.json [production]
10:40 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2163 (T401906)', diff saved to https://phabricator.wikimedia.org/P82465 and previous config saved to /var/cache/conftool/dbconfig/20250903-104047-fceratto.json [production]
10:40 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2163.codfw.wmnet with reason: Maintenance [production]
10:40 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T401906)', diff saved to https://phabricator.wikimedia.org/P82464 and previous config saved to /var/cache/conftool/dbconfig/20250903-104023-fceratto.json [production]
10:28 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve1012.eqiad.wmnet with reason: host reimage [production]
10:25 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P82463 and previous config saved to /var/cache/conftool/dbconfig/20250903-102516-fceratto.json [production]
10:22 <elukey@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve1012.eqiad.wmnet with reason: host reimage [production]
10:17 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Depooling db1243 (T402925)', diff saved to https://phabricator.wikimedia.org/P82462 and previous config saved to /var/cache/conftool/dbconfig/20250903-101749-ladsgroup.json [production]
10:17 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1243.eqiad.wmnet with reason: Maintenance [production]
10:17 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1242 (T402925)', diff saved to https://phabricator.wikimedia.org/P82461 and previous config saved to /var/cache/conftool/dbconfig/20250903-101725-ladsgroup.json [production]
10:16 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component ingress-admission [tools]
10:10 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P82460 and previous config saved to /var/cache/conftool/dbconfig/20250903-101008-fceratto.json [production]