1-50 of 10000 results (24ms)
2026-02-21 §
02:02 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
02:02 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add mgmt ip for asw1-23-uslfo - pt1979@cumin2002" [production]
02:02 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add mgmt ip for asw1-23-uslfo - pt1979@cumin2002" [production]
02:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
01:59 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
01:15 <dwisehaupt> updating localsettings from 71c98072 to 534fbf34 and syncing civicrm to push update for large_donation_notifications [fundraising]
01:08 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2236 (T415786)', diff saved to https://phabricator.wikimedia.org/P88944 and previous config saved to /var/cache/conftool/dbconfig/20260221-010845-marostegui.json [production]
01:08 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2236.codfw.wmnet with reason: Maintenance [production]
01:08 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2219 (T415786)', diff saved to https://phabricator.wikimedia.org/P88943 and previous config saved to /var/cache/conftool/dbconfig/20260221-010820-marostegui.json [production]
00:53 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2219', diff saved to https://phabricator.wikimedia.org/P88942 and previous config saved to /var/cache/conftool/dbconfig/20260221-005312-marostegui.json [production]
00:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2219', diff saved to https://phabricator.wikimedia.org/P88941 and previous config saved to /var/cache/conftool/dbconfig/20260221-003804-marostegui.json [production]
00:22 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2219 (T415786)', diff saved to https://phabricator.wikimedia.org/P88940 and previous config saved to /var/cache/conftool/dbconfig/20260221-002255-marostegui.json [production]
2026-02-20 §
23:03 <eevans@cumin1003> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
23:03 <eevans@cumin1003> START - Cookbook sre.network.cf [production]
23:02 <eevans@cumin1003> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
23:02 <eevans@cumin1003> START - Cookbook sre.network.cf [production]
22:35 <eevans@cumin1003> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
22:35 <eevans@cumin1003> START - Cookbook sre.network.cf [production]
21:47 <bd808> Unblock 168.184.84.0/24 (T418020) [releng]
21:10 <eevans@cumin1003> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool site esams [reason: no reason specified, ] [production]
21:10 <eevans@cumin1003> START - Cookbook sre.dns.admin DNS admin: pool site esams [reason: no reason specified, ] [production]
20:38 <ejegg> donorwiki upgraded from f7a0ee6b to f5d7179a [fundraising]
20:17 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-runner:24 [tools]
20:17 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-runner:24 [tools]
20:16 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-runner:24 [tools]
20:16 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-runner:24 [tools]
19:47 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-builder:22_20240105 [tools]
19:46 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-builder:22_20240105 [tools]
19:45 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-builder:22_20240105 [tools]
19:45 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-builder:22_20240105 [tools]
19:44 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-builder:22_20240105 [tools]
19:44 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image toolsbeta-harbor.wmcloud.org/toolforge/heroku-builder:22_20240105 [tools]
19:16 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site esams [reason: no reason specified, ] [production]
19:16 <sukhe@cumin1003> START - Cookbook sre.dns.admin DNS admin: depool site esams [reason: no reason specified, ] [production]
19:14 <sukhe@cumin1003> END (FAIL) - Cookbook sre.dns.admin (exit_code=99) DNS admin: depool site esams [reason: no reason specified, ] [production]
19:12 <sukhe@cumin1003> START - Cookbook sre.dns.admin DNS admin: depool site esams [reason: no reason specified, ] [production]
19:12 <sukhe@cumin1003> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
19:12 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
19:08 <sukhe@cumin1003> END (FAIL) - Cookbook sre.network.cf (exit_code=1) [production]
19:08 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
19:07 <sukhe@cumin1003> END (FAIL) - Cookbook sre.network.cf (exit_code=1) [production]
19:07 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
19:07 <sukhe@cumin1003> END (FAIL) - Cookbook sre.network.cf (exit_code=1) [production]
19:07 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
18:52 <dwisehaupt@dns1004> END - running authdns-update [production]
18:50 <dwisehaupt@dns1004> START - running authdns-update [production]
18:43 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host moss-fe2021.codfw.wmnet with OS bullseye [production]
18:42 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host moss-fe2021.codfw.wmnet with OS bullseye [production]
17:47 <mutante> gerrit added Alex Sanford to wmf-deployment group - already has deployment shell group T418015 [production]
17:18 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host moss-fe2022.codfw.wmnet with OS bullseye [production]