401-450 of 10000 results (87ms)
2024-06-04 ยง
10:27 <hashar@deploy1002> Started deploy [releng/jenkins-deploy@5d3a06d] (releasing): (no justification provided) [production]
10:24 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: dumps::generation::worker::dumper [production]
10:23 <claime> Migrating votewiki to mw-on-k8s - T362323 [production]
10:22 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid2002.codfw.wmnet [production]
10:20 <filippo@cumin1002> START - Cookbook sre.hosts.reboot-single for host centrallog1002.eqiad.wmnet [production]
10:18 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host failoid2002.codfw.wmnet [production]
10:16 <hashar> Upgrading CI Jenkins # T366008 [production]
10:15 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudlb1002.eqiad.wmnet [production]
10:15 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1156.eqiad.wmnet with reason: host reimage [production]
10:12 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db1156.eqiad.wmnet with reason: host reimage [production]
10:10 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host clouddb2002-dev.codfw.wmnet [production]
10:09 <mvernon@cumin2002> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling reboot on P{ms-fe2*} and (A:swift-fe or A:swift-fe-canary or A:swift-fe-codfw or A:swift-fe-eqiad) [production]
10:08 <marostegui> dbmaint eqiad s1 deploy schema change on db1184 T364299 [production]
10:07 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: dumps::generation::worker::dumper_monitor [production]
10:07 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudlb1002.eqiad.wmnet [production]
10:06 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudlb1001.eqiad.wmnet [production]
10:04 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host clouddb2002-dev.codfw.wmnet [production]
10:04 <mvernon@cumin2002> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling reboot on P{ms-fe1*} and (A:swift-fe or A:swift-fe-canary or A:swift-fe-codfw or A:swift-fe-eqiad) [production]
10:00 <marostegui@cumin1002> dbctl commit (dc=all): 'Set db2212 with weight 0 T366552', diff saved to https://phabricator.wikimedia.org/P63993 and previous config saved to /var/cache/conftool/dbconfig/20240604-100024-root.json [production]
10:00 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 35 hosts with reason: Primary switchover s1 T366552 [production]
09:59 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on 35 hosts with reason: Primary switchover s1 T366552 [production]
09:58 <marostegui@cumin1002> START - Cookbook sre.hosts.reimage for host db1156.eqiad.wmnet with OS bookworm [production]
09:58 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudlb1001.eqiad.wmnet [production]
09:57 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudlb2003-dev.codfw.wmnet [production]
09:56 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcumin1001.eqiad.wmnet [production]
09:54 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudgw2003-dev.codfw.wmnet [production]
09:53 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cuminunpriv1001.eqiad.wmnet [production]
09:53 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudcumin1001.eqiad.wmnet [production]
09:48 <filippo@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host centrallog2002.codfw.wmnet [production]
09:48 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudlb2003-dev.codfw.wmnet [production]
09:48 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudgw2003-dev.codfw.wmnet [production]
09:47 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host cuminunpriv1001.eqiad.wmnet [production]
09:45 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcumin2001.codfw.wmnet [production]
09:45 <filippo@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host graphite2004.codfw.wmnet [production]
09:45 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudlb2002-dev.codfw.wmnet [production]
09:44 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudgw2002-dev.codfw.wmnet [production]
09:43 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install3003.wikimedia.org [production]
09:42 <filippo@cumin1002> START - Cookbook sre.hosts.reboot-single for host centrallog2002.codfw.wmnet [production]
09:41 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudcumin2001.codfw.wmnet [production]
09:40 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcontrol2008-dev.codfw.wmnet [production]
09:40 <filippo@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mwlog2002.codfw.wmnet [production]
09:39 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: dumps::generation::worker::dumper_monitor [production]
09:38 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudgw2002-dev.codfw.wmnet [production]
09:37 <filippo@cumin1002> START - Cookbook sre.hosts.reboot-single for host graphite2004.codfw.wmnet [production]
09:37 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudweb1004.wikimedia.org [production]
09:37 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host install3003.wikimedia.org [production]
09:36 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudlb2002-dev.codfw.wmnet [production]
09:36 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudlb2001-dev.codfw.wmnet [production]
09:34 <taavi@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudcontrol2008-dev.codfw.wmnet [production]
09:34 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudcontrol2007-dev.codfw.wmnet [production]