7701-7750 of 10000 results (92ms)
2022-12-06 ยง
17:47 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti5006.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:47 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dns5003.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:47 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs5006.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:47 <robh@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti5005.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:29 <robh@cumin2002> START - Cookbook sre.hosts.provision for host ganeti5005.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:29 <robh@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host lvs5005.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:29 <cwhite@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host logstash1027.eqiad.wmnet with OS bullseye [production]
17:28 <robh@cumin2002> START - Cookbook sre.hosts.provision for host dns5003.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:27 <robh@cumin2002> START - Cookbook sre.hosts.provision for host lvs5006.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:27 <robh@cumin2002> START - Cookbook sre.hosts.provision for host lvs5005.mgmt.eqsin.wmnet with reboot policy FORCED [production]
17:25 <robh@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dns5003 [production]
17:25 <robh@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host dns5003 [production]
17:25 <robh@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti5007 [production]
17:25 <robh@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti5007 [production]
17:24 <robh@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti5006 [production]
17:24 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2002.codfw.wmnet with OS bullseye [production]
17:24 <robh@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti5006 [production]
17:24 <robh@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti5005 [production]
17:23 <robh@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti5005 [production]
17:22 <cwhite@cumin2002> START - Cookbook sre.hosts.reimage for host logstash1028.eqiad.wmnet with OS bullseye [production]
17:21 <robh@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host lvs5006 [production]
17:21 <robh@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host lvs5006 [production]
17:17 <cwhite@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host logstash1029.eqiad.wmnet with OS bullseye [production]
17:13 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
17:12 <cwhite@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host logstash1028.eqiad.wmnet with OS bullseye [production]
17:03 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
17:01 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:51 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:50 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
16:50 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
16:48 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
16:48 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
16:47 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
16:47 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
16:46 <kostajh> UTC afternoon backports done [production]
16:44 <kharlan@deploy1002> Finished scap: Backport for [[gerrit:860867|GrowthExperiments: Start oldimpact experiment (T323526)]] (duration: 10m 54s) [production]
16:35 <kharlan@deploy1002> kharlan and kharlan: Backport for [[gerrit:860867|GrowthExperiments: Start oldimpact experiment (T323526)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
16:33 <kharlan@deploy1002> Started scap: Backport for [[gerrit:860867|GrowthExperiments: Start oldimpact experiment (T323526)]] [production]
16:32 <cwhite@cumin2002> START - Cookbook sre.hosts.reimage for host logstash1027.eqiad.wmnet with OS bullseye [production]
16:30 <kharlan@deploy1002> Finished scap: Backport for [[gerrit:862840|GrowthExperiments: Enable new impact module on pilot wikis (T323686)]] (duration: 10m 14s) [production]
16:23 <cwhite@cumin2002> START - Cookbook sre.hosts.reimage for host logstash1028.eqiad.wmnet with OS bullseye [production]
16:21 <kharlan@deploy1002> kharlan and kharlan: Backport for [[gerrit:862840|GrowthExperiments: Enable new impact module on pilot wikis (T323686)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
16:21 <robh@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host lvs5005 [production]
16:21 <robh@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host lvs5005 [production]
16:21 <cwhite@cumin2002> START - Cookbook sre.hosts.reimage for host logstash1029.eqiad.wmnet with OS bullseye [production]
16:21 <robh@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:21 <robh@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: eqsin new hosts - robh@cumin2002" [production]
16:19 <kharlan@deploy1002> Started scap: Backport for [[gerrit:862840|GrowthExperiments: Enable new impact module on pilot wikis (T323686)]] [production]
16:18 <kharlan@deploy1002> backport aborted: (duration: 02m 53s) [production]
16:16 <robh@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: eqsin new hosts - robh@cumin2002" [production]