501-550 of 10000 results (104ms)
2024-07-31 ยง
22:23 <pt1979@cumin1002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
22:19 <pt1979@cumin1002> START - Cookbook sre.dns.netbox [production]
22:17 <pt1979@cumin1002> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
22:15 <pt1979@cumin1002> START - Cookbook sre.dns.netbox [production]
22:10 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host alert2002.mgmt.codfw.wmnet with reboot policy FORCED [production]
22:09 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host alert2002.mgmt.codfw.wmnet with reboot policy FORCED [production]
21:52 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:50 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
21:28 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1256.mgmt.eqiad.wmnet with reboot policy FORCED [production]
21:27 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1256.mgmt.eqiad.wmnet with reboot policy FORCED [production]
21:27 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1256.mgmt.eqiad.wmnet with reboot policy FORCED [production]
21:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1256.mgmt.eqiad.wmnet with reboot policy FORCED [production]
21:17 <xcollazo@deploy1003> Finished deploy [airflow-dags/analytics@82674dc]: deploy hot airflow analytics dag hot fix T368756 (duration: 01m 05s) [production]
21:16 <xcollazo@deploy1003> Started deploy [airflow-dags/analytics@82674dc]: deploy hot airflow analytics dag hot fix T368756 [production]
21:10 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on cp7015.magru.wmnet with reason: T371554 [production]
21:10 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on cp7015.magru.wmnet with reason: T371554 [production]
21:09 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:06 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
21:04 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:02 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
20:56 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1257.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:55 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1256.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:55 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1255.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:54 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1254.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:54 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1253.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:53 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1259.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:53 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1251.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:53 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1252.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:53 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1250.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:52 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1258.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:49 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1258.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:49 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1258.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:47 <brett@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp7015.magru.wmnet [production]
20:45 <cjming> end of UTC late backport window [production]
20:44 <cjming@deploy1003> Finished scap: Backport for [[gerrit:1055484|beta: Enable NetworkSession extension (T355267)]] (duration: 07m 47s) [production]
20:40 <cjming@deploy1003> ebernhardson, cjming: Continuing with sync [production]
20:39 <cjming@deploy1003> ebernhardson, cjming: Backport for [[gerrit:1055484|beta: Enable NetworkSession extension (T355267)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:37 <cjming@deploy1003> Started scap sync-world: Backport for [[gerrit:1055484|beta: Enable NetworkSession extension (T355267)]] [production]
20:34 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1257.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:34 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1257.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:31 <cjming@deploy1003> Finished scap: Backport for [[gerrit:1058584|[arwiki] Set noindex for namespace user (T371470)]] (duration: 17m 28s) [production]
20:27 <cjming@deploy1003> cjming, gergesshamon: Continuing with sync [production]
20:26 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1258.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:25 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1257.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:25 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1256.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:25 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1259.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:24 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1255.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:24 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1254.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:24 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1253.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:24 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host wikikube-worker1252.mgmt.eqiad.wmnet with reboot policy FORCED [production]