1801-1850 of 10000 results (95ms)
2024-07-11 ยง
21:57 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192 (T367781)', diff saved to https://phabricator.wikimedia.org/P66348 and previous config saved to /var/cache/conftool/dbconfig/20240711-215700-arnaudb.json [production]
21:44 <rzl> rzl@mwdebug1002:~$ sudo apache2ctl restart [production]
21:41 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P66347 and previous config saved to /var/cache/conftool/dbconfig/20240711-214153-arnaudb.json [production]
21:38 <jhathaway> upgrading exim4 to 4.94.2-7+deb11u3 [production]
21:26 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P66346 and previous config saved to /var/cache/conftool/dbconfig/20240711-212646-arnaudb.json [production]
21:13 <catrope@deploy1002> Finished scap: Backport for [[gerrit:1051487|Change Linter log level to info]] (duration: 14m 40s) [production]
21:11 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_eqiad [production]
21:11 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192 (T367781)', diff saved to https://phabricator.wikimedia.org/P66345 and previous config saved to /var/cache/conftool/dbconfig/20240711-211138-arnaudb.json [production]
21:11 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_eqiad [production]
21:08 <catrope@deploy1002> arlolra, catrope: Continuing with sync [production]
21:07 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db2192 (T367781)', diff saved to https://phabricator.wikimedia.org/P66344 and previous config saved to /var/cache/conftool/dbconfig/20240711-210747-arnaudb.json [production]
21:07 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2192.codfw.wmnet with reason: Maintenance [production]
21:07 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2192.codfw.wmnet with reason: Maintenance [production]
21:07 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T367781)', diff saved to https://phabricator.wikimedia.org/P66343 and previous config saved to /var/cache/conftool/dbconfig/20240711-210725-arnaudb.json [production]
21:05 <catrope@deploy1002> arlolra, catrope: Backport for [[gerrit:1051487|Change Linter log level to info]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:59 <catrope@deploy1002> Started scap sync-world: Backport for [[gerrit:1051487|Change Linter log level to info]] [production]
20:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P66342 and previous config saved to /var/cache/conftool/dbconfig/20240711-205218-arnaudb.json [production]
20:37 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P66341 and previous config saved to /var/cache/conftool/dbconfig/20240711-203711-arnaudb.json [production]
20:37 <catrope@deploy1002> Finished scap: Backport for [[gerrit:1053708|Vector theme should default to day (T369833)]] (duration: 17m 09s) [production]
20:32 <catrope@deploy1002> jdlrobson, catrope: Continuing with sync [production]
20:30 <catrope@deploy1002> jdlrobson, catrope: Backport for [[gerrit:1053708|Vector theme should default to day (T369833)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:29 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2005.codfw.wmnet with OS bookworm [production]
20:28 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" [production]
20:26 <eileen> config revision changed from 540f27e6 to c25da839 renable silverpop_daily [production]
20:22 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T367781)', diff saved to https://phabricator.wikimedia.org/P66340 and previous config saved to /var/cache/conftool/dbconfig/20240711-202204-arnaudb.json [production]
20:19 <catrope@deploy1002> Started scap sync-world: Backport for [[gerrit:1053708|Vector theme should default to day (T369833)]] [production]
20:18 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db2178 (T367781)', diff saved to https://phabricator.wikimedia.org/P66339 and previous config saved to /var/cache/conftool/dbconfig/20240711-201815-arnaudb.json [production]
20:18 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2178.codfw.wmnet with reason: Maintenance [production]
20:17 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2178.codfw.wmnet with reason: Maintenance [production]
20:17 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171 (T367781)', diff saved to https://phabricator.wikimedia.org/P66338 and previous config saved to /var/cache/conftool/dbconfig/20240711-201753-arnaudb.json [production]
20:15 <catrope@deploy1002> Finished scap: Backport for [[gerrit:1053771|Graph: Fix JSON parse errors in Graph data source tracking]] (duration: 13m 32s) [production]
20:10 <catrope@deploy1002> catrope: Continuing with sync [production]
20:08 <catrope@deploy1002> catrope: Backport for [[gerrit:1053771|Graph: Fix JSON parse errors in Graph data source tracking]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:02 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171', diff saved to https://phabricator.wikimedia.org/P66337 and previous config saved to /var/cache/conftool/dbconfig/20240711-200246-arnaudb.json [production]
20:01 <catrope@deploy1002> Started scap sync-world: Backport for [[gerrit:1053771|Graph: Fix JSON parse errors in Graph data source tracking]] [production]
19:47 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171', diff saved to https://phabricator.wikimedia.org/P66336 and previous config saved to /var/cache/conftool/dbconfig/20240711-194739-arnaudb.json [production]
19:32 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171 (T367781)', diff saved to https://phabricator.wikimedia.org/P66335 and previous config saved to /var/cache/conftool/dbconfig/20240711-193231-arnaudb.json [production]
19:28 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db2171 (T367781)', diff saved to https://phabricator.wikimedia.org/P66334 and previous config saved to /var/cache/conftool/dbconfig/20240711-192842-arnaudb.json [production]
19:28 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
19:28 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
19:28 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157 (T367781)', diff saved to https://phabricator.wikimedia.org/P66333 and previous config saved to /var/cache/conftool/dbconfig/20240711-192820-arnaudb.json [production]
19:23 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" [production]
19:13 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P66332 and previous config saved to /var/cache/conftool/dbconfig/20240711-191313-arnaudb.json [production]
19:12 <swfrench@deploy1002> helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply [production]
19:11 <swfrench@deploy1002> helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply [production]
19:09 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbproxy2005.codfw.wmnet with reason: host reimage [production]
19:06 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dbproxy2005.codfw.wmnet with reason: host reimage [production]
18:58 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P66331 and previous config saved to /var/cache/conftool/dbconfig/20240711-185805-arnaudb.json [production]
18:52 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host dbproxy2005.codfw.wmnet with OS bookworm [production]
18:42 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157 (T367781)', diff saved to https://phabricator.wikimedia.org/P66330 and previous config saved to /var/cache/conftool/dbconfig/20240711-184258-arnaudb.json [production]