1901-1950 of 10000 results (39ms)
2024-12-12 §
08:00 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on dbproxy1023.eqiad.wmnet with reason: maintenance [production]
08:00 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
08:00 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
07:56 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
07:56 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
07:52 <moritzm> installing upx-ucl security updates [production]
2024-12-11 §
23:24 <tzatziki> removing 7 files for legal compliance [production]
23:02 <tzatziki> removing 4 files for legal compliance [production]
22:52 <tzatziki> removing three files for legal compliance [production]
21:53 <eileen> civicrm upgraded from ddda6d67 to 0d7f2866 [production]
21:33 <TheresNoTime> done UTC late backport window [production]
21:32 <samtar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1102205|Follow-up I9df39fdcc: Convert missed 'this' to 'el' (T381741)]] (duration: 10m 01s) [production]
21:26 <samtar@deploy2002> novemlinguae, samtar: Continuing with sync [production]
21:25 <samtar@deploy2002> novemlinguae, samtar: Backport for [[gerrit:1102205|Follow-up I9df39fdcc: Convert missed 'this' to 'el' (T381741)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:22 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudelastic1011.eqiad.wmnet with OS bullseye [production]
21:22 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudelastic1012.eqiad.wmnet with OS bullseye [production]
21:22 <samtar@deploy2002> Started scap sync-world: Backport for [[gerrit:1102205|Follow-up I9df39fdcc: Convert missed 'this' to 'el' (T381741)]] [production]
21:14 <samtar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1101937|Enable AutoModerator on bnwiki (T381000)]] (duration: 11m 01s) [production]
21:11 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host cloudelastic1012.eqiad.wmnet with OS bullseye [production]
21:11 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host cloudelastic1011.eqiad.wmnet with OS bullseye [production]
21:10 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudelastic1011.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:10 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudelastic1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:08 <samtar@deploy2002> kgraessle, samtar: Continuing with sync [production]
21:08 <samtar@deploy2002> kgraessle, samtar: Backport for [[gerrit:1101937|Enable AutoModerator on bnwiki (T381000)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:03 <samtar@deploy2002> Started scap sync-world: Backport for [[gerrit:1101937|Enable AutoModerator on bnwiki (T381000)]] [production]
21:00 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host cloudelastic1011.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
21:00 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host cloudelastic1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
20:42 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on aqs1014.eqiad.wmnet with reason: Hardware replacement [production]
20:42 <eevans@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on aqs1014.eqiad.wmnet with reason: Hardware replacement [production]
18:18 <claime> homer 'lsw1-d6-codfw*' commit 'T379788' [production]
18:17 <claime> homer 'lsw1-c1-codfw*' commit 'T379788' [production]
18:16 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts wikikube-worker[2180-2183].codfw.wmnet [production]
18:16 <cgoubert@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:16 <cgoubert@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: wikikube-worker[2180-2183].codfw.wmnet decommissioned, removing all IPs except the asset tag one - cgoubert@cumin1002" [production]
18:15 <cgoubert@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: wikikube-worker[2180-2183].codfw.wmnet decommissioned, removing all IPs except the asset tag one - cgoubert@cumin1002" [production]
18:10 <cgoubert@cumin1002> START - Cookbook sre.dns.netbox [production]
18:06 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:06 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:05 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:05 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:05 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:05 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:04 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:04 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
18:00 <cgoubert@cumin1002> START - Cookbook sre.hosts.decommission for hosts wikikube-worker[2180-2183].codfw.wmnet [production]
17:59 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
17:59 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
17:58 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
17:58 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply [production]
17:55 <claime> homer 'lsw1-a6-codfw' commit 'T379788' [production]