6251-6300 of 10000 results (157ms)
2024-05-29 ยง
10:00 <sfaci@deploy1002> helmfile [eqiad] START helmfile.d/services/edit-analytics: apply [production]
09:59 <sfaci@deploy1002> helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply [production]
09:57 <sfaci@deploy1002> helmfile [codfw] START helmfile.d/services/edit-analytics: apply [production]
09:54 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2121 (T364299)', diff saved to https://phabricator.wikimedia.org/P63514 and previous config saved to /var/cache/conftool/dbconfig/20240529-095437-marostegui.json [production]
09:54 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2121.codfw.wmnet with reason: Maintenance [production]
09:54 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2121.codfw.wmnet with reason: Maintenance [production]
09:51 <dcausse@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:50 <dcausse@deploy1002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:47 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1234.eqiad.wmnet [production]
09:39 <sfaci@deploy1002> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
09:38 <sfaci@deploy1002> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
09:38 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: sync [production]
09:37 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: sync [production]
09:36 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: sync [production]
09:36 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-parsoid: sync [production]
09:32 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1232.eqiad.wmnet [production]
09:29 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: sync [production]
09:27 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: sync [production]
09:16 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1232.eqiad.wmnet [production]
09:12 <marostegui> Deploy schema change on s7 eqiad dbmaint T307501 [production]
09:05 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 8674 [production]
08:59 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2098.codfw.wmnet with reason: Maintenance [production]
08:59 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2098.codfw.wmnet with reason: Maintenance [production]
08:40 <brouberol@deploy1002> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
08:39 <brouberol@deploy1002> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
08:35 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'configure' for AS: 8674 [production]
08:33 <brouberol@deploy1002> helmfile [staging] DONE helmfile.d/services/edit-analytics: sync [production]
08:31 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 49666 [production]
08:29 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'email' for AS: 49666 [production]
08:22 <brouberol@deploy1002> helmfile [staging] START helmfile.d/services/edit-analytics: sync [production]
08:10 <brouberol@deploy1002> helmfile [staging] DONE helmfile.d/services/edit-analytics: sync [production]
08:00 <brouberol@deploy1002> helmfile [staging] START helmfile.d/services/edit-analytics: sync [production]
07:55 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1228.eqiad.wmnet [production]
07:54 <dcausse@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
07:54 <dcausse@deploy1002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
07:47 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1228.eqiad.wmnet [production]
07:47 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1219.eqiad.wmnet [production]
07:35 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1219.eqiad.wmnet [production]
07:30 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance [production]
07:30 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance [production]
07:30 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1227 (T364299)', diff saved to https://phabricator.wikimedia.org/P63513 and previous config saved to /var/cache/conftool/dbconfig/20240529-073017-marostegui.json [production]
07:15 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1227', diff saved to https://phabricator.wikimedia.org/P63512 and previous config saved to /var/cache/conftool/dbconfig/20240529-071509-marostegui.json [production]
07:00 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1227', diff saved to https://phabricator.wikimedia.org/P63511 and previous config saved to /var/cache/conftool/dbconfig/20240529-070001-marostegui.json [production]
06:59 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db1218.eqiad.wmnet [production]
06:49 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db1218.eqiad.wmnet [production]
06:44 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1227 (T364299)', diff saved to https://phabricator.wikimedia.org/P63510 and previous config saved to /var/cache/conftool/dbconfig/20240529-064453-marostegui.json [production]
04:24 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1227 (T364299)', diff saved to https://phabricator.wikimedia.org/P63509 and previous config saved to /var/cache/conftool/dbconfig/20240529-042402-marostegui.json [production]
04:23 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1227.eqiad.wmnet with reason: Maintenance [production]
04:23 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db1227.eqiad.wmnet with reason: Maintenance [production]
04:23 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1202 (T364299)', diff saved to https://phabricator.wikimedia.org/P63508 and previous config saved to /var/cache/conftool/dbconfig/20240529-042339-marostegui.json [production]