201-250 of 10000 results (27ms)
2026-02-04 ยง
18:21 <eevans@cumin1003> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching aqs[2001,2003-2012,1011-1021]*: Applying upgrade to Java 11.0.30 - eevans@cumin1003 [production]
18:21 <dzahn@dns1004> START - running authdns-update [production]
18:21 <daniel@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
18:20 <dzahn@dns1004> END - running authdns-update [production]
18:19 <dzahn@dns1004> START - running authdns-update [production]
17:44 <dwisehaupt@dns1004> END - running authdns-update [production]
17:42 <dwisehaupt@dns1004> START - running authdns-update [production]
17:41 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host bast1004.wikimedia.org with OS trixie [production]
17:39 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project duct in eqiad1 [duct]
17:38 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.delete_project for project duct in eqiad1 [duct]
17:36 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2182 (T415786)', diff saved to https://phabricator.wikimedia.org/P88668 and previous config saved to /var/cache/conftool/dbconfig/20260204-173612-marostegui.json [production]
17:36 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2182.codfw.wmnet with reason: Maintenance [production]
17:35 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project duct in eqiad1 [duct]
17:35 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.delete_project for project duct in eqiad1 [duct]
17:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2168 (T415786)', diff saved to https://phabricator.wikimedia.org/P88667 and previous config saved to /var/cache/conftool/dbconfig/20260204-173547-marostegui.json [production]
17:30 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project wmf-dumps-playground in eqiad1 [wmf-dumps-playground]
17:28 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.delete_project for project wmf-dumps-playground in eqiad1 [wmf-dumps-playground]
17:28 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [wmde-techwishes-survey]
17:28 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [wlm-it-visual]
17:27 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [wikidocumentaries]
17:26 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [wikicommunityhealth]
17:26 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [webperf]
17:25 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [wcdo]
17:25 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [usdtest]
17:24 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [teyora]
17:24 <jclark@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on bast1004.wikimedia.org with reason: host reimage [production]
17:24 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [security-tools]
17:23 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [samplecomplexapp]
17:23 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [procbot]
17:22 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [openvas]
17:22 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [onfire]
17:21 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [netops-clab]
17:21 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [matrix]
17:21 <jclark@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on bast1004.wikimedia.org with reason: host reimage [production]
17:20 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P88666 and previous config saved to /var/cache/conftool/dbconfig/20260204-172039-marostegui.json [production]
17:19 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [ipoidopensearch]
17:19 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [imagehash]
17:19 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [imagebulk]
17:18 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [huggle]
17:17 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [hoiscript]
17:17 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [glamwikidashboard]
17:17 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [glams]
17:16 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [fastcci]
17:15 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project duct in eqiad1 [duct]
17:15 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.delete_project for project duct in eqiad1 [duct]
17:14 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project duct in eqiad1 [duct]
17:14 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.delete_project for project duct in eqiad1 [duct]
17:14 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [defectdojo]
17:14 <taavi> turning off VMs per no response to https://wikitech.wikimedia.org/wiki/News/2025_Cloud_VPS_Purge [cluebotng-review]
17:12 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project checkuser-beta-wiki in eqiad1 [checkuser-beta-wiki]