3101-3150 of 10000 results (26ms)
2025-03-20 ยง
15:02 <jnuche@deploy2002> Started deploy [releng/jenkins-deploy@c274545] (releasing): (no justification provided) [production]
15:01 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]
15:00 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply [production]
14:59 <jnuche@deploy2002> Finished deploy [releng/jenkins-deploy@c274545] (releasing): (no justification provided) (duration: 00m 33s) [production]
14:58 <jnuche@deploy2002> Started deploy [releng/jenkins-deploy@c274545] (releasing): (no justification provided) [production]
14:58 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:57 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:57 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: try rolling operation without allow-yellow flag - bking@cumin2002 - T389119 [production]
14:52 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:52 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:52 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:52 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:51 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]
14:51 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply [production]
14:50 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:50 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
14:49 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:49 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
14:49 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1129837|GlobalContributions: Do not look up permissions for registered target (T389187)]], [[gerrit:1129838|GlobalContributionsPagerTest: De-duplicate getting new pager]], [[gerrit:1129839|GlobalContributions: Do not look up permissions for registered target (T389187)]] (duration: 15m 04s) [production]
14:42 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:41 <dreamyjazz@deploy2002> dreamyjazz: Continuing with sync [production]
14:38 <dreamyjazz@deploy2002> dreamyjazz: Backport for [[gerrit:1129837|GlobalContributions: Do not look up permissions for registered target (T389187)]], [[gerrit:1129838|GlobalContributionsPagerTest: De-duplicate getting new pager]], [[gerrit:1129839|GlobalContributions: Do not look up permissions for registered target (T389187)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:36 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:35 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: upgrade search plugins - bking@cumin2002 - T389119 [production]
14:34 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1129837|GlobalContributions: Do not look up permissions for registered target (T389187)]], [[gerrit:1129838|GlobalContributionsPagerTest: De-duplicate getting new pager]], [[gerrit:1129839|GlobalContributions: Do not look up permissions for registered target (T389187)]] [production]
14:12 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:12 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:12 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: upgrade search plugins - bking@cumin2002 - T389119 [production]
14:11 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: upgrade search plugins - bking@cumin2002 - T389119 [production]
14:08 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
14:08 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: upgrade search plugins - bking@cumin2002 - T389119 [production]
14:04 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'chuckonwumelu' in role 'member' [paws]
14:04 <aborrero@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'chuckonwumelu' in role 'member' [paws]
14:04 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'chuckonwumelu' in role 'member' [toolsbeta]
14:04 <aborrero@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'chuckonwumelu' in role 'member' [toolsbeta]
14:04 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'chuckonwumelu' in role 'member' [tools]
14:04 <aborrero@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'chuckonwumelu' in role 'member' [tools]
13:58 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:57 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:57 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:56 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:56 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1129821|Enable SUL3 login for 10% of group 1 users (T384153)]] (duration: 11m 18s) [production]
13:53 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:48 <sgimeno@deploy2002> tgr, sgimeno: Continuing with sync [production]
13:47 <sgimeno@deploy2002> tgr, sgimeno: Backport for [[gerrit:1129821|Enable SUL3 login for 10% of group 1 users (T384153)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:44 <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1129821|Enable SUL3 login for 10% of group 1 users (T384153)]] [production]
13:39 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1129819|analytics(GrowthExperimentsInteractionLogger): add edit_count to the event data (T388622)]], [[gerrit:1129820|feat(SurfacingStructuredTasks): increase max edit cap to 100 (T388622)]] (duration: 11m 00s) [production]
13:32 <sgimeno@deploy2002> sgimeno: Continuing with sync [production]
13:31 <sgimeno@deploy2002> sgimeno: Backport for [[gerrit:1129819|analytics(GrowthExperimentsInteractionLogger): add edit_count to the event data (T388622)]], [[gerrit:1129820|feat(SurfacingStructuredTasks): increase max edit cap to 100 (T388622)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:30 <moritzm> remove ganeti-test2001 for reimage T382515 [production]