1801-1850 of 10000 results (101ms)
2024-07-12 ยง
17:03 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1350.eqiad.wmnet with OS buster [production]
17:00 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1349.eqiad.wmnet with OS buster [production]
16:32 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1351.eqiad.wmnet with reason: host reimage [production]
16:29 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1350.eqiad.wmnet with reason: host reimage [production]
16:27 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1349.eqiad.wmnet with reason: host reimage [production]
16:24 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1351.eqiad.wmnet with reason: host reimage [production]
16:24 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1350.eqiad.wmnet with reason: host reimage [production]
16:23 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1349.eqiad.wmnet with reason: host reimage [production]
16:17 <dcausse@deploy1002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
16:16 <dcausse@deploy1002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
16:10 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw1351.eqiad.wmnet with OS buster [production]
16:09 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw1350.eqiad.wmnet with OS buster [production]
16:09 <cgoubert@cumin1002> START - Cookbook sre.hosts.reimage for host mw1349.eqiad.wmnet with OS buster [production]
16:05 <cgoubert@cumin1002> conftool action : set/pooled=inactive; selector: name=(mw1349|mw1350|mw1351).eqiad.wmnet,cluster=(jobrunner|videoscaler) [production]
16:05 <cgoubert@cumin1002> conftool action : set/pooled=yes; selector: name=(mw1349|mw1350|mw1351).eqiad.wmnet,cluster=(jobrunner|videoscaler) [production]
16:04 <claime> pooling mw1349, mw1350, mw1351 as jobrunners [production]
16:03 <cgoubert@cumin1002> conftool action : set/pooled=no:weight=10; selector: name=(mw1349|mw1350|mw1351).eqiad.wmnet,cluster=(jobrunner|videoscaler) [production]
16:01 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1351.eqiad.wmnet with OS buster [production]
16:01 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for mw1350.eqiad.wmnet [production]
16:01 <cgoubert@cumin1002> START - Cookbook sre.hosts.remove-downtime for mw1350.eqiad.wmnet [production]
16:00 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for mw1349.eqiad.wmnet [production]
16:00 <cgoubert@cumin1002> START - Cookbook sre.hosts.remove-downtime for mw1349.eqiad.wmnet [production]
15:59 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1350.eqiad.wmnet with OS buster [production]
15:58 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mw1349.eqiad.wmnet with OS buster [production]
15:57 <cgoubert@cumin1002> conftool action : set/pooled=no:weight=10; selector: name=(mw1349|mw1350|mw1351).eqiad.wmnet,cluster=jobrunner [production]
15:57 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet [production]
15:49 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2220 (T367856)', diff saved to https://phabricator.wikimedia.org/P66408 and previous config saved to /var/cache/conftool/dbconfig/20240712-154954-marostegui.json [production]
15:49 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2220.codfw.wmnet with reason: Maintenance [production]
15:49 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2220.codfw.wmnet with reason: Maintenance [production]
15:49 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2218 (T367856)', diff saved to https://phabricator.wikimedia.org/P66407 and previous config saved to /var/cache/conftool/dbconfig/20240712-154921-marostegui.json [production]
15:47 <dcausse@deploy1002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
15:47 <dcausse@deploy1002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
15:46 <pt1979@cumin2002> START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet [production]
15:46 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet [production]
15:46 <pt1979@cumin2002> START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet [production]
15:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2218', diff saved to https://phabricator.wikimedia.org/P66406 and previous config saved to /var/cache/conftool/dbconfig/20240712-153414-marostegui.json [production]
15:33 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/commons-impact-analytics: apply [production]
15:33 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1351.eqiad.wmnet with reason: host reimage [production]
15:32 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/commons-impact-analytics: apply [production]
15:26 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/commons-impact-analytics: apply [production]
15:26 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1350.eqiad.wmnet with reason: host reimage [production]
15:25 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/commons-impact-analytics: apply [production]
15:23 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1349.eqiad.wmnet with reason: host reimage [production]
15:21 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1351.eqiad.wmnet with reason: host reimage [production]
15:21 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1350.eqiad.wmnet with reason: host reimage [production]
15:21 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1349.eqiad.wmnet with reason: host reimage [production]
15:20 <swfrench@deploy1002> helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply [production]
15:20 <swfrench@deploy1002> helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply [production]
15:19 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2218', diff saved to https://phabricator.wikimedia.org/P66405 and previous config saved to /var/cache/conftool/dbconfig/20240712-151907-marostegui.json [production]
15:17 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]