901-950 of 10000 results (72ms)
2023-07-03 ยง
13:19 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:934624|SpecialLog: Fix issues related to IP users (T338042 T340929)]] [production]
13:18 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1011.eqiad.wmnet [production]
13:18 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti1011.eqiad.wmnet [production]
13:10 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:935048|Set wgCollectionDisableSidebarLink for nowiki (T340981)]] (duration: 08m 09s) [production]
13:09 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1011.eqiad.wmnet [production]
13:07 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1010.eqiad.wmnet [production]
13:07 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1010.eqiad.wmnet [production]
13:04 <urbanecm@deploy1002> jhsoby and urbanecm: Backport for [[gerrit:935048|Set wgCollectionDisableSidebarLink for nowiki (T340981)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
13:02 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:935048|Set wgCollectionDisableSidebarLink for nowiki (T340981)]] [production]
13:00 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
13:00 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1010.eqiad.wmnet [production]
12:59 <kart_> Updated MinT to 2023-06-29-061037-production (T340709 + Fixed repeatation with Santali) [production]
12:57 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
12:51 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
12:50 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
12:46 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
12:42 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1010.eqiad.wmnet [production]
12:41 <kartik@deploy1002> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
12:35 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1009.eqiad.wmnet [production]
12:35 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1009.eqiad.wmnet [production]
12:33 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
12:31 <kartik@deploy1002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
12:29 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1009.eqiad.wmnet [production]
12:23 <kart_> Updated cxserver to 2023-07-03-045311-production (T285217) [production]
12:22 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1009.eqiad.wmnet [production]
12:18 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
12:17 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
12:12 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Awjrichards out of all services on: 1271 hosts [production]
12:12 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
12:12 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Awjrichards out of all services on: 1271 hosts [production]
12:12 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Awjrichards out of all services on: 20 hosts [production]
12:12 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Awjrichards out of all services on: 20 hosts [production]
12:12 <kartik@deploy1002> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
12:11 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Awjrichards out of all services on: 760 hosts [production]
12:11 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Awjrichards out of all services on: 760 hosts [production]
12:09 <kartik@deploy1002> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
12:08 <kartik@deploy1002> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
12:04 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging JMinor out of all services on: 760 hosts [production]
12:04 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging JMinor out of all services on: 760 hosts [production]
12:04 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging JMinor out of all services on: 1271 hosts [production]
12:03 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging JMinor out of all services on: 1271 hosts [production]
12:03 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging JMinor out of all services on: 20 hosts [production]
12:03 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging JMinor out of all services on: 20 hosts [production]
11:38 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
11:35 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
11:35 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
11:33 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
11:30 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
11:30 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
11:26 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Jameel Kaisar out of all services on: 20 hosts [production]