1-50 of 10000 results (29ms)
2023-09-20 ยง
23:55 <jclark@cumin1001> START - Cookbook sre.hosts.provision for host pc1016.mgmt.eqiad.wmnet with reboot policy FORCED [production]
23:54 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host pc1016.mgmt.eqiad.wmnet with reboot policy FORCED [production]
23:51 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host pc1015.mgmt.eqiad.wmnet with reboot policy FORCED [production]
23:51 <jclark@cumin1001> START - Cookbook sre.hosts.provision for host pc1015.mgmt.eqiad.wmnet with reboot policy FORCED [production]
23:50 <jclark@cumin1001> START - Cookbook sre.hosts.provision for host pc1016.mgmt.eqiad.wmnet with reboot policy FORCED [production]
23:50 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host pc1015.mgmt.eqiad.wmnet with reboot policy FORCED [production]
23:50 <jclark@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host pc1016 [production]
23:50 <jclark@cumin1001> START - Cookbook sre.hosts.provision for host pc1015.mgmt.eqiad.wmnet with reboot policy FORCED [production]
23:49 <jclark@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host pc1015 [production]
23:49 <jclark@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host pc1015 [production]
23:49 <jclark@cumin1001> END (ERROR) - Cookbook sre.network.configure-switch-interfaces (exit_code=97) for host pc1016 [production]
23:49 <jclark@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host pc1016 [production]
23:48 <jclark@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host pc1016 [production]
23:48 <jclark@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
23:48 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt pc1016 - jclark@cumin1001" [production]
23:47 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt pc1016 - jclark@cumin1001" [production]
23:44 <jclark@cumin1001> START - Cookbook sre.dns.netbox [production]
21:49 <root@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
21:45 <root@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
21:38 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
21:35 <root@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
21:34 <root@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
21:31 <root@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
19:55 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.apt.copy_to_main_repo (exit_code=0) for package 'toolforge-webservice' version '0.103' [tools]
19:54 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.apt.copy_to_main_repo for package 'toolforge-webservice' version '0.103' [tools]
19:26 <bearloga@deploy2002> Finished deploy [airflow-dags/analytics_product@80496b8]: (no justification provided) (duration: 00m 05s) [production]
19:26 <bearloga@deploy2002> Started deploy [airflow-dags/analytics_product@80496b8]: (no justification provided) [production]
19:25 <bearloga@deploy2002> Finished deploy [airflow-dags/analytics_product@80496b8]: (no justification provided) (duration: 00m 09s) [production]
19:24 <bearloga@deploy2002> Started deploy [airflow-dags/analytics_product@80496b8]: (no justification provided) [production]
18:21 <brennen@deploy2002> Synchronized php: group1 wikis to 1.41.0-wmf.27 refs T345888 (duration: 07m 17s) [production]
18:14 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.27 refs T345888 [production]
18:02 <brennen> train 1.41.0-wmf.27 (T345888): no current blockers, logs clean, rolling to group1 [production]
16:51 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance mcrouter [packaging]
16:51 <fnegri@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance mcrouter [packaging]
16:37 <James_F> Configure CI to support REL1_41 for T346923 [releng]
16:29 <elukey@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
16:28 <elukey@deploy2002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
16:26 <elukey@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
16:26 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
16:26 <klausman> pushing revert of ORES TTL change [production]
16:24 <elukey@deploy2002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
16:23 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
15:53 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance mcrouter [packaging]
15:53 <fnegri@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance mcrouter [packaging]
15:30 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
15:30 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
15:29 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
15:29 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
15:29 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
15:29 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]