1851-1900 of 10000 results (54ms)
2024-06-20 ยง
22:13 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P65267 and previous config saved to /var/cache/conftool/dbconfig/20240620-221340-marostegui.json [production]
21:58 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P65266 and previous config saved to /var/cache/conftool/dbconfig/20240620-215833-marostegui.json [production]
21:44 <dancy> Upgraded buildkitd to v0.14.1 in gitlab-cloud-runners staging and production (T367352) [releng]
21:43 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2169 (T367856)', diff saved to https://phabricator.wikimedia.org/P65265 and previous config saved to /var/cache/conftool/dbconfig/20240620-214326-marostegui.json [production]
21:38 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=99) for server 14789ac1-bc06-4677-9bb0-66c16c887427 [admin]
21:38 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server 14789ac1-bc06-4677-9bb0-66c16c887427 [admin]
21:28 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [testlabs]
21:23 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [testlabs]
21:23 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=99) for server tbd [testlabs]
21:23 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [testlabs]
21:12 <ebernhardson@deploy1002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
21:12 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/page-analytics: apply [production]
21:12 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/page-analytics: apply [production]
21:11 <ebernhardson@deploy1002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
21:10 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/media-analytics: apply [production]
21:09 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/media-analytics: apply [production]
21:09 <brett> Include ncmonitor 1.0.0 in wikimedia-bookworm apt repo [production]
21:09 <pfischer@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
21:08 <ebernhardson@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
21:08 <pfischer@deploy1002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
21:08 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/geo-analytics: apply [production]
21:07 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/geo-analytics: apply [production]
21:07 <ebernhardson@deploy1002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
21:06 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply [production]
21:06 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/editor-analytics: apply [production]
21:05 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply [production]
21:04 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/edit-analytics: apply [production]
21:03 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_database_instance_to_ovs (exit_code=0) for server tbd [testlabs]
21:03 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/device-analytics: apply [production]
21:03 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/device-analytics: apply [production]
20:59 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_database_instance_to_ovs for server tbd [testlabs]
20:57 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_database_instance_to_ovs (exit_code=0) for server tbd [testlabs]
20:53 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_database_instance_to_ovs for server tbd [testlabs]
20:53 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6 days, 0:00:00 on elastic1105.eqiad.wmnet with reason: T348977 [production]
20:53 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 6 days, 0:00:00 on elastic1105.eqiad.wmnet with reason: T348977 [production]
20:46 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_database_instance_to_ovs (exit_code=99) for server tbd [testlabs]
20:44 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/page-analytics: apply [production]
20:44 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/page-analytics: apply [production]
20:43 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/media-analytics: apply [production]
20:42 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/media-analytics: apply [production]
20:41 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_database_instance_to_ovs for server tbd [testlabs]
20:40 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/geo-analytics: apply [production]
20:40 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/geo-analytics: apply [production]
20:39 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/editor-analytics: apply [production]
20:38 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/editor-analytics: apply [production]
20:36 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply [production]
20:36 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/edit-analytics: apply [production]
20:34 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/device-analytics: apply [production]
20:33 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/device-analytics: apply [production]
20:29 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_database_instance_to_ovs (exit_code=99) for server tbd [testlabs]