4701-4750 of 10000 results (101ms)
2023-06-28 §
07:08 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2002.codfw.wmnet [production]
07:07 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2002.codfw.wmnet [production]
07:07 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
07:06 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
06:42 <marostegui> Failover m1-master to dbproxy1024 T337812 [production]
01:37 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: installing (but not registering) magnum-ui (duration: 02m 20s) [production]
01:35 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: installing (but not registering) magnum-ui [production]
01:24 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: installing (but not registering) magnum-ui (duration: 01m 58s) [production]
01:22 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: installing (but not registering) magnum-ui [production]
2023-06-27 §
23:58 <denisse@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host xhgui2002.codfw.wmnet [production]
23:58 <denisse@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host xhgui2002.codfw.wmnet with OS bookworm [production]
23:49 <denisse@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host xhgui1002.eqiad.wmnet [production]
23:49 <denisse@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host xhgui1002.eqiad.wmnet with OS bookworm [production]
23:43 <denisse@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on xhgui2002.codfw.wmnet with reason: host reimage [production]
23:40 <denisse@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on xhgui2002.codfw.wmnet with reason: host reimage [production]
23:34 <denisse@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on xhgui1002.eqiad.wmnet with reason: host reimage [production]
23:31 <denisse@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on xhgui1002.eqiad.wmnet with reason: host reimage [production]
23:23 <denisse@cumin1001> START - Cookbook sre.hosts.reimage for host xhgui2002.codfw.wmnet with OS bookworm [production]
23:23 <denisse@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM xhgui2002.codfw.wmnet - denisse@cumin1001" [production]
23:22 <denisse@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM xhgui2002.codfw.wmnet - denisse@cumin1001" [production]
23:22 <denisse@cumin1001> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) xhgui2002.codfw.wmnet on all recursors [production]
23:22 <denisse@cumin1001> START - Cookbook sre.dns.wipe-cache xhgui2002.codfw.wmnet on all recursors [production]
23:22 <denisse@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:22 <denisse@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM xhgui2002.codfw.wmnet - denisse@cumin1001" [production]
23:21 <denisse@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM xhgui2002.codfw.wmnet - denisse@cumin1001" [production]
23:20 <denisse@cumin1001> START - Cookbook sre.hosts.reimage for host xhgui1002.eqiad.wmnet with OS bookworm [production]
23:20 <denisse@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM xhgui1002.eqiad.wmnet - denisse@cumin1001" [production]
23:19 <denisse@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM xhgui1002.eqiad.wmnet - denisse@cumin1001" [production]
23:19 <denisse@cumin1001> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) xhgui1002.eqiad.wmnet on all recursors [production]
23:19 <denisse@cumin1001> START - Cookbook sre.dns.wipe-cache xhgui1002.eqiad.wmnet on all recursors [production]
23:19 <denisse@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:19 <denisse@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM xhgui1002.eqiad.wmnet - denisse@cumin1001" [production]
23:18 <denisse@cumin1001> START - Cookbook sre.dns.netbox [production]
23:18 <denisse@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM xhgui1002.eqiad.wmnet - denisse@cumin1001" [production]
23:18 <denisse@cumin1001> START - Cookbook sre.ganeti.makevm for new host xhgui2002.codfw.wmnet [production]
23:16 <denisse@cumin1001> START - Cookbook sre.dns.netbox [production]
23:16 <denisse@cumin1001> START - Cookbook sre.ganeti.makevm for new host xhgui1002.eqiad.wmnet [production]
22:43 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: installing (but not registering) magnum-ui (duration: 01m 27s) [production]
22:42 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: installing (but not registering) magnum-ui [production]
21:50 <mutante> prometheus4002 - sudo a2dismod access_compat ; sudo systemctl restart apach2 ; sudo apachectl configtest -> Syntax OK :) - to proof it works without the access_compat module T258686 [production]
21:45 <mutante> prometheus* - puppet and partially manaul restart of apaches after deploying gerrit:932443 [production]
20:50 <TheresNoTime> close UTC late backport window [production]
20:48 <samtar@deploy1002> Finished scap: Backport for [[gerrit:933626|Title: Fix exists() assertion in toPageRecord() (T340568)]] (duration: 06m 52s) [production]
20:43 <samtar@deploy1002> matmarex and samtar: Backport for [[gerrit:933626|Title: Fix exists() assertion in toPageRecord() (T340568)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
20:41 <samtar@deploy1002> Started scap: Backport for [[gerrit:933626|Title: Fix exists() assertion in toPageRecord() (T340568)]] [production]
20:20 <samtar@deploy1002> Finished scap: Backport for [[gerrit:927653|Remove most DiscussionTools feature configs (T322497)]], [[gerrit:932270|Remove references to auth-api.php (T204193)]] (duration: 06m 53s) [production]
20:17 <jforrester@deploy1002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
20:16 <jforrester@deploy1002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
20:15 <samtar@deploy1002> reedy and esanders and samtar: Backport for [[gerrit:927653|Remove most DiscussionTools feature configs (T322497)]], [[gerrit:932270|Remove references to auth-api.php (T204193)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
20:13 <samtar@deploy1002> Started scap: Backport for [[gerrit:927653|Remove most DiscussionTools feature configs (T322497)]], [[gerrit:932270|Remove references to auth-api.php (T204193)]] [production]