51-100 of 10000 results (103ms)
2025-04-02 ยง
17:08 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on cirrussearch2055.codfw.wmnet with reason: adding net-new role [production]
16:52 <reedy@deploy1003> Started scap sync-world: Backport for [[gerrit:1133468|EmailAuth: Allow forceEmailAuth test check without extension dependencies (T390437)]], [[gerrit:1133470|EmailAuth: Add tests for EmailAuthRequireToken handler (T390437)]], [[gerrit:1133472|EmailAuthHooks: Exclude bot users from email auth check (T390662)]], [[gerrit:1133469|EmailAuth: Add tests for EmailAuthRequireToken handler (T390437)]], [[ger [production]
16:27 <vgutierrez> reload varnish on text@codfw to discard stale VCLs - T390846 [production]
16:26 <swfrench@deploy1003> Finished scap sync-world: Deployment to pick up change in mediawiki-deployments.yaml - T389499 (duration: 03m 21s) [production]
16:25 <swfrench@deploy1003> swfrench: Continuing with sync [production]
16:24 <swfrench@deploy1003> swfrench: Deployment to pick up change in mediawiki-deployments.yaml - T389499 synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:23 <vgutierrez> reload varnish on text@drmrs to discard stale VCLs - T390846 [production]
16:23 <swfrench@deploy1003> Started scap sync-world: Deployment to pick up change in mediawiki-deployments.yaml - T389499 [production]
16:10 <swfrench-wmf> run-puppet-agent on deploy1003 to pick up mediawiki-deployments.yaml changes - T389499 [production]
15:28 <arnaudb@dns1004> END - running authdns-update [production]
15:19 <arnaudb@dns1004> START - running authdns-update [production]
15:16 <arnaudb@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on gerrit2002.wikimedia.org with reason: maintenance [production]
15:15 <arnaudb@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on gerrit1003.wikimedia.org with reason: maintenance [production]
15:07 <elukey@deploy1003> helmfile [codfw] DONE helmfile.d/services/changeprop: sync [production]
15:06 <elukey@deploy1003> helmfile [codfw] START helmfile.d/services/changeprop: sync [production]
14:49 <ayounsi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1042.eqiad.wmnet [production]
14:43 <ayounsi@cumin1002> START - Cookbook sre.hosts.reboot-single for host ganeti1042.eqiad.wmnet [production]
14:43 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host apus-fe2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:43 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host apus-fe2003.codfw.wmnet with OS bookworm [production]
14:35 <sukhe@cumin1002> END (PASS) - Cookbook sre.dns.roll-restart (exit_code=0) rolling restart_daemons on A:dnsbox [production]
14:18 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
14:17 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
14:15 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1042.eqiad.wmnet [production]
14:13 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1042.eqiad.wmnet [production]
14:12 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
14:12 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
14:11 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:11 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:10 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:10 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:07 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
14:06 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
14:06 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:06 <volans@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Release v0.8.0 - volans@cumin1002 [production]
14:05 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:05 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:04 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:04 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
14:03 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
14:01 <volans> upgrading homer to version 0.8.0 to cumin hosts [production]
14:01 <stevemunene@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
14:00 <volans@cumin1002> START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Release v0.8.0 - volans@cumin1002 [production]
13:55 <ayounsi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1041.eqiad.wmnet [production]
13:52 <sukhe@cumin1002> END (PASS) - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns (exit_code=0) rolling restart_daemons on A:wikidough [production]
13:49 <ayounsi@cumin1002> START - Cookbook sre.hosts.reboot-single for host ganeti1041.eqiad.wmnet [production]
13:49 <stevemunene@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
13:43 <stevemunene@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
13:43 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1041.eqiad.wmnet [production]
13:41 <stevemunene@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
13:41 <ayounsi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1040.eqiad.wmnet [production]