251-300 of 10000 results (17ms)
2025-07-17 ยง
20:37 <bvibber@deploy1003> bvibber: Continuing with sync [production]
20:36 <bvibber@deploy1003> bvibber: Backport for [[gerrit:1170422|Database index hack to speed chartinfo API (T393950)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:34 <bvibber@deploy1003> Started scap sync-world: Backport for [[gerrit:1170422|Database index hack to speed chartinfo API (T393950)]] [production]
20:20 <sbisson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1170412|CX3 Build 1.0.0+20250717 (T388503 T395417 T395418)]] (duration: 11m 10s) [production]
20:14 <sbisson@deploy1003> sbisson: Continuing with sync [production]
20:11 <sbisson@deploy1003> sbisson: Backport for [[gerrit:1170412|CX3 Build 1.0.0+20250717 (T388503 T395417 T395418)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:09 <sbisson@deploy1003> Started scap sync-world: Backport for [[gerrit:1170412|CX3 Build 1.0.0+20250717 (T388503 T395417 T395418)]] [production]
19:29 <wmbot~lucaswerkmeister@tools-bastion-13> deployed 672ec5bee8 (l10n updates: yue-hant, zh-hant) [tools.lexeme-forms]
19:03 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti1054.eqiad.wmnet with OS bookworm [production]
19:03 <vriley@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1002" [production]
19:03 <vriley@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1002" [production]
18:48 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti1054.eqiad.wmnet with reason: host reimage [production]
18:43 <vriley@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti1054.eqiad.wmnet with reason: host reimage [production]
18:32 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host pc2016.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
18:30 <vriley@cumin1002> START - Cookbook sre.hosts.reimage for host ganeti1054.eqiad.wmnet with OS bookworm [production]
18:27 <vriley@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
18:20 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
18:19 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host pc2016.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
18:15 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
18:12 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
18:12 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
18:12 <dancy@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.45.0-wmf.10 refs T392180 [production]
18:10 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
18:09 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
18:08 <jhancock@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:05 <jhancock@cumin1003> START - Cookbook sre.dns.netbox [production]
18:03 <gmodena@deploy1003> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:03 <gmodena@deploy1003> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
18:00 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host pc2016 [production]
18:00 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host pc2016 [production]
17:59 <jhancock@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:57 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
17:57 <jhancock@cumin1003> START - Cookbook sre.dns.netbox [production]
17:44 <vriley@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
17:40 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
17:38 <bd808@deploy1003> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
17:38 <vriley@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti1054 [production]
17:37 <bd808@deploy1003> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
17:37 <bd808@deploy1003> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
17:37 <bd808@deploy1003> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
17:36 <vriley@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti1054 [production]
17:36 <bd808@deploy1003> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
17:36 <bd808@deploy1003> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
17:36 <vriley@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:36 <vriley@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt ganeti1054 - vriley@cumin1002" [production]
17:36 <vriley@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt ganeti1054 - vriley@cumin1002" [production]
17:32 <vriley@cumin1002> START - Cookbook sre.dns.netbox [production]
17:14 <swfrench@deploy1003> Finished scap sync-world: Migrate webserver-bookworm flavour back to (bookworm) mediawiki-httpd images - T378128 (duration: 09m 56s) [production]
17:08 <swfrench@deploy1003> swfrench: Continuing with sync [production]
17:06 <swfrench@deploy1003> swfrench: Migrate webserver-bookworm flavour back to (bookworm) mediawiki-httpd images - T378128 synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]