51-100 of 10000 results (37ms)
2026-07-10 §
09:15 <blake@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1053 - blake@cumin1003" [production]
09:15 <blake@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1053 - blake@cumin1003" [production]
09:11 <blake@cumin1003> START - Cookbook sre.dns.netbox [production]
09:11 <blake@cumin1003> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1053 [production]
09:08 <blake@cumin1003> START - Cookbook sre.hosts.reimage for host wikikube-worker1053.eqiad.wmnet with OS trixie [production]
09:08 <blake@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1053.eqiad.wmnet [production]
09:08 <blake@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1053.eqiad.wmnet [production]
09:08 <blake@cumin1003> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1053.eqiad.wmnet [production]
09:06 <blake@cumin1003> END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker1053.eqiad.wmnet [production]
09:06 <blake@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1053.eqiad.wmnet [production]
09:06 <blake@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1053.eqiad.wmnet [production]
09:06 <blake@cumin1003> START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1053.eqiad.wmnet [production]
09:04 <brouberol@dns1004> END - running authdns-update [production]
09:03 <brouberol@dns1004> START - running authdns-update [production]
08:41 <javiermonton@deploy2003> Finished deploy [analytics/refinery@1abf22e] (thin): Regular analytics weekly train THIN [analytics/refinery@1abf22ea] (duration: 02m 11s) [production]
08:38 <javiermonton@deploy2003> Started deploy [analytics/refinery@1abf22e] (thin): Regular analytics weekly train THIN [analytics/refinery@1abf22ea] [production]
08:38 <javiermonton@deploy2003> Finished deploy [analytics/refinery@1abf22e]: Regular analytics weekly train [analytics/refinery@1abf22ea] (duration: 05m 17s) [production]
08:38 <bwojtowicz@deploy2003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
08:34 <bwojtowicz@deploy2003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
08:33 <javiermonton@deploy2003> Started deploy [analytics/refinery@1abf22e]: Regular analytics weekly train [analytics/refinery@1abf22ea] [production]
08:32 <javiermonton@deploy2003> Finished deploy [analytics/refinery@1abf22e] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@1abf22ea] (duration: 02m 03s) [production]
08:30 <javiermonton@deploy2003> Started deploy [analytics/refinery@1abf22e] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@1abf22ea] [production]
08:30 <JavierMonton> Deploying Refinery at 1abf22ea for changes 1308121/T427068 1306491/T430020 and 1308190 [production]
08:30 <JavierMonton> Deploying Refinery at 1abf22ea for changes 1308121/T427068 1306491/T430020 and 1308190 [analytics]
08:29 <dcausse@deploy2003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
08:29 <dcausse@deploy2003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
08:24 <dcausse@deploy2003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
08:24 <dcausse@deploy2003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
08:18 <dcausse@deploy2003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
08:18 <dcausse@deploy2003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
08:00 <jynus@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for db[2183-2184].codfw.wmnet [production]
08:00 <jynus@cumin1003> START - Cookbook sre.hosts.remove-downtime for db[2183-2184].codfw.wmnet [production]
07:52 <dcausse@deploy2003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:52 <dcausse@deploy2003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:49 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 11 hosts with reason: reboot & upgrade [production]
07:47 <dcausse@deploy2003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:47 <dcausse@deploy2003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:44 <dcausse@deploy2003> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:44 <dcausse@deploy2003> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:23 <jynus@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 10 hosts [production]
07:23 <jynus@cumin1003> START - Cookbook sre.hosts.remove-downtime for 10 hosts [production]
06:45 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 10 hosts with reason: reboot & upgrade [production]
02:07 <mwpresync@deploy2003> Finished scap build-images: Publishing wmf/next image (duration: 06m 41s) [production]
02:00 <mwpresync@deploy2003> Started scap build-images: Publishing wmf/next image [production]
2026-07-09 §
23:33 <ladsgroup@deploy2003> Finished scap sync-world: Backport for [[gerrit:1308671|Enable section share on Persian Wikipedia (T431514)]] (duration: 13m 26s) [production]
23:29 <ladsgroup@deploy2003> ladsgroup, jdlrobson: Continuing with deployment [production]
23:25 <AntiComposite> restart all CVNBots [cvn]
23:22 <ladsgroup@deploy2003> ladsgroup, jdlrobson: Backport for [[gerrit:1308671|Enable section share on Persian Wikipedia (T431514)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
23:20 <ladsgroup@deploy2003> Started scap sync-world: Backport for [[gerrit:1308671|Enable section share on Persian Wikipedia (T431514)]] [production]
22:57 <jasmine@cumin2002> END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker1165.eqiad.wmnet [production]