251-300 of 10000 results (25ms)
2026-01-12 ยง
17:33 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P87392 and previous config saved to /var/cache/conftool/dbconfig/20260112-173308-marostegui.json [production]
17:32 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
17:32 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission [tools]
17:28 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2176 (T413525)', diff saved to https://phabricator.wikimedia.org/P87391 and previous config saved to /var/cache/conftool/dbconfig/20260112-172808-marostegui.json [production]
17:28 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2176.codfw.wmnet with reason: Maintenance [production]
17:27 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2174 (T413525)', diff saved to https://phabricator.wikimedia.org/P87390 and previous config saved to /var/cache/conftool/dbconfig/20260112-172744-marostegui.json [production]
17:23 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1218 (T413525)', diff saved to https://phabricator.wikimedia.org/P87389 and previous config saved to /var/cache/conftool/dbconfig/20260112-172259-marostegui.json [production]
17:22 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component registry-admission [tools]
17:22 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission [toolsbeta]
17:17 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P87388 and previous config saved to /var/cache/conftool/dbconfig/20260112-171735-marostegui.json [production]
17:16 <wmbot~lucaswerkmeister@tools-bastion-15> deployed b6cd1e9722 (handle mwoauth-invalid-authorization) [tools.quickcategories]
17:14 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component registry-admission [toolsbeta]
17:14 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers [tools]
17:07 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P87387 and previous config saved to /var/cache/conftool/dbconfig/20260112-170727-marostegui.json [production]
16:57 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2174 (T413525)', diff saved to https://phabricator.wikimedia.org/P87386 and previous config saved to /var/cache/conftool/dbconfig/20260112-165718-marostegui.json [production]
16:56 <taavi> delete unused cache directory T319965 [tools.phetools]
16:54 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers [tools]
16:53 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers [toolsbeta]
16:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1218 (T413525)', diff saved to https://phabricator.wikimedia.org/P87385 and previous config saved to /var/cache/conftool/dbconfig/20260112-165253-marostegui.json [production]
16:52 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1218.eqiad.wmnet with reason: Maintenance [production]
16:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206 (T413525)', diff saved to https://phabricator.wikimedia.org/P87384 and previous config saved to /var/cache/conftool/dbconfig/20260112-165229-marostegui.json [production]
16:42 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P87383 and previous config saved to /var/cache/conftool/dbconfig/20260112-164220-marostegui.json [production]
16:38 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers [toolsbeta]
16:38 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [tools]
16:35 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudlb1002.eqiad.wmnet with OS trixie [production]
16:33 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [tools]
16:33 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [toolsbeta]
16:33 <urbanecm@deploy2002> mwscript-k8s job started: GrowthExperiments:revalidateLinkRecommendations.php --wiki=plwiki --all --verbose # revalidate-addlink [production]
16:32 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P87382 and previous config saved to /var/cache/conftool/dbconfig/20260112-163212-marostegui.json [production]
16:29 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [toolsbeta]
16:29 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api [tools]
16:27 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
16:27 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
16:24 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2174 (T413525)', diff saved to https://phabricator.wikimedia.org/P87381 and previous config saved to /var/cache/conftool/dbconfig/20260112-162445-marostegui.json [production]
16:24 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2174.codfw.wmnet with reason: Maintenance [production]
16:24 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2173 (T413525)', diff saved to https://phabricator.wikimedia.org/P87380 and previous config saved to /var/cache/conftool/dbconfig/20260112-162421-marostegui.json [production]
16:22 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1206 (T413525)', diff saved to https://phabricator.wikimedia.org/P87379 and previous config saved to /var/cache/conftool/dbconfig/20260112-162204-marostegui.json [production]
16:20 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [tools]
16:20 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api [toolsbeta]
16:16 <btullis@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host an-test-druid1001.eqiad.wmnet with OS bookworm [production]
16:16 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-test-druid1001.eqiad.wmnet with OS bookworm [production]
16:15 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudlb1002.eqiad.wmnet with reason: host reimage [production]
16:14 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2173', diff saved to https://phabricator.wikimedia.org/P87378 and previous config saved to /var/cache/conftool/dbconfig/20260112-161412-marostegui.json [production]
16:11 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logs-api [toolsbeta]
16:11 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudlb1002.eqiad.wmnet with reason: host reimage [production]
16:04 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2173', diff saved to https://phabricator.wikimedia.org/P87377 and previous config saved to /var/cache/conftool/dbconfig/20260112-160404-marostegui.json [production]
15:58 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1031.eqiad.wmnet with OS trixie [production]
15:55 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudlb1002.eqiad.wmnet with OS trixie [production]
15:54 <andrewbogott> stopping bird on cloudlb1002, reimaging to Trixie [admin]
15:53 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2173 (T413525)', diff saved to https://phabricator.wikimedia.org/P87376 and previous config saved to /var/cache/conftool/dbconfig/20260112-155356-marostegui.json [production]