3701-3750 of 10000 results (29ms)
2025-09-25 ยง
07:22 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1190702|Growth [testwiki]: enable new notifications and reduce scheduling time (T404085)]], [[gerrit:1189617|mswikiquote: set timezone, sitename and project namespace (T404700)]], [[gerrit:1189616|mswikiquote: add logo (T404700)]] [production]
07:17 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1025.eqiad.wmnet [production]
07:07 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1025.eqiad.wmnet [production]
07:06 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1024.eqiad.wmnet [production]
07:06 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1024.eqiad.wmnet [production]
07:00 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1024.eqiad.wmnet [production]
06:52 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1024.eqiad.wmnet [production]
06:50 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1023.eqiad.wmnet [production]
06:50 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1023.eqiad.wmnet [production]
06:44 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1023.eqiad.wmnet [production]
06:43 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1023.eqiad.wmnet [production]
06:33 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1191233|CheckUser/UserInfoCard: Phase 2 enable by default on pilot wikis (T405342)]] (duration: 11m 22s) [production]
06:31 <gehel> restarting blazegraph on wdqs-main@codfw [production]
06:28 <kharlan@deploy1003> kharlan: Continuing with sync [production]
06:26 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1191233|CheckUser/UserInfoCard: Phase 2 enable by default on pilot wikis (T405342)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
06:21 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1191233|CheckUser/UserInfoCard: Phase 2 enable by default on pilot wikis (T405342)]] [production]
05:30 <kart_> staging: Updated cxserver to 2025-09-25-051716-production (T394982) [production]
05:27 <kartik@deploy1003> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
05:26 <kartik@deploy1003> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
05:03 <eileen> civicrm upgraded from c1a08ee7 to a53165c1 [production]
04:56 <eileen> civicrm upgraded from 67156d98 to c1a08ee7 [production]
03:35 <eileen> civicrm upgraded from c9211920 to 67156d98 [production]
02:18 <eileen> civicrm upgraded from 6ce95d83 to c9211920 [production]
01:33 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
01:31 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
01:29 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1210.eqiad.wmnet with OS bullseye [production]
01:29 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bullseye [production]
01:20 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1210.eqiad.wmnet with OS bullseye [production]
01:20 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bullseye [production]
01:15 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1210.eqiad.wmnet with OS bullseye [production]
01:15 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bullseye [production]
01:13 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1231.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
01:11 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1229.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
01:11 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1230.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
01:11 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1232.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
01:08 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1216.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:49 <eileen> civicrm upgraded from cf8bdf15 to 6ce95d83 [production]
00:48 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host an-worker1216.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:48 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1228.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:46 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1227.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:45 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host an-worker1231.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:44 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host an-worker1232.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:44 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host an-worker1230.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:42 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host an-worker1229.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:42 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1226.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:41 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1225.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:41 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1223.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:40 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1224.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:21 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host an-worker1228.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
00:21 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1222.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]