4501-4550 of 10000 results (98ms)
2023-11-13 §
10:49 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1161 (T348183)', diff saved to https://phabricator.wikimedia.org/P53313 and previous config saved to /var/cache/conftool/dbconfig/20231113-104917-arnaudb.json [production]
10:45 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db1161 (T348183)', diff saved to https://phabricator.wikimedia.org/P53312 and previous config saved to /var/cache/conftool/dbconfig/20231113-104534-arnaudb.json [production]
10:45 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
10:45 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
10:45 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1161.eqiad.wmnet with reason: Maintenance [production]
10:44 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1161.eqiad.wmnet with reason: Maintenance [production]
10:43 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1145.eqiad.wmnet with reason: Maintenance [production]
10:42 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1145.eqiad.wmnet with reason: Maintenance [production]
10:42 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1144:3315 (T348183)', diff saved to https://phabricator.wikimedia.org/P53311 and previous config saved to /var/cache/conftool/dbconfig/20231113-104245-arnaudb.json [production]
10:38 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 983 [production]
10:27 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1144:3315', diff saved to https://phabricator.wikimedia.org/P53309 and previous config saved to /var/cache/conftool/dbconfig/20231113-102739-arnaudb.json [production]
10:27 <arnaudb@cumin1001> dbctl commit (dc=all): 'depool T350458', diff saved to https://phabricator.wikimedia.org/P53308 and previous config saved to /var/cache/conftool/dbconfig/20231113-102730-arnaudb.json [production]
10:24 <jbond@cumin1001> START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm [production]
10:00 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: graphite::production [production]
09:57 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1144:3315', diff saved to https://phabricator.wikimedia.org/P53307 and previous config saved to /var/cache/conftool/dbconfig/20231113-095725-arnaudb.json [production]
09:44 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: graphite::production [production]
09:43 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: arclamp [production]
09:42 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1144:3315 (T348183)', diff saved to https://phabricator.wikimedia.org/P53306 and previous config saved to /var/cache/conftool/dbconfig/20231113-094218-arnaudb.json [production]
09:38 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db1144:3315 (T348183)', diff saved to https://phabricator.wikimedia.org/P53305 and previous config saved to /var/cache/conftool/dbconfig/20231113-093824-arnaudb.json [production]
09:38 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1144.eqiad.wmnet with reason: Maintenance [production]
09:38 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1144.eqiad.wmnet with reason: Maintenance [production]
09:38 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1130 (T348183)', diff saved to https://phabricator.wikimedia.org/P53304 and previous config saved to /var/cache/conftool/dbconfig/20231113-093802-arnaudb.json [production]
09:36 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: arclamp [production]
09:31 <moritzm> installing dbus security updates on bullseye [production]
09:31 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: labswiki to 1.42.0-wmf.4 (T350836 T350080) [production]
09:22 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1130', diff saved to https://phabricator.wikimedia.org/P53303 and previous config saved to /var/cache/conftool/dbconfig/20231113-092256-arnaudb.json [production]
09:16 <hashar@deploy2002> Finished deploy [integration/docroot@9bf1967]: Replace WikimediaUI Base with Codex design tokens T331403 T334934 (duration: 00m 07s) [production]
09:16 <hashar@deploy2002> Started deploy [integration/docroot@9bf1967]: Replace WikimediaUI Base with Codex design tokens T331403 T334934 [production]
09:14 <jnuche@deploy2002> Finished scap: Backport for [[gerrit:973247|Fix BlockDisablesLogin recursion (T350836 T350080)]] (duration: 07m 49s) [production]
09:08 <jnuche@deploy2002> bd808 and jnuche: Continuing with sync [production]
09:08 <jnuche@deploy2002> bd808 and jnuche: Backport for [[gerrit:973247|Fix BlockDisablesLogin recursion (T350836 T350080)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
09:07 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1130', diff saved to https://phabricator.wikimedia.org/P53302 and previous config saved to /var/cache/conftool/dbconfig/20231113-090750-arnaudb.json [production]
09:06 <jnuche@deploy2002> Started scap: Backport for [[gerrit:973247|Fix BlockDisablesLogin recursion (T350836 T350080)]] [production]
08:58 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host webperf2003.codfw.wmnet [production]
08:55 <godog> bounce prometheus eqiad for k8s / k8s-aux - T343529 [production]
08:52 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1130 (T348183)', diff saved to https://phabricator.wikimedia.org/P53301 and previous config saved to /var/cache/conftool/dbconfig/20231113-085243-arnaudb.json [production]
08:49 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db1130 (T348183)', diff saved to https://phabricator.wikimedia.org/P53300 and previous config saved to /var/cache/conftool/dbconfig/20231113-084945-arnaudb.json [production]
08:49 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1130.eqiad.wmnet with reason: Maintenance [production]
08:49 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1130.eqiad.wmnet with reason: Maintenance [production]
08:45 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host webperf2003.codfw.wmnet [production]
08:39 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host graphite2004.codfw.wmnet [production]
08:34 <hashar@deploy2002> Finished deploy [integration/docroot@bc8aaba]: Add more libraries to doc.wikimedia.org homepage - T327604 (duration: 00m 06s) [production]
08:34 <hashar@deploy2002> Started deploy [integration/docroot@bc8aaba]: Add more libraries to doc.wikimedia.org homepage - T327604 [production]
08:30 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host graphite2004.codfw.wmnet [production]
08:29 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host arclamp2001.codfw.wmnet [production]
08:20 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host arclamp2001.codfw.wmnet [production]
07:54 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: search::loader [production]
07:42 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: search::loader [production]
2023-11-12 §
21:28 <jiji@cumin2002> END (PASS) - Cookbook sre.mediawiki.restart-appservers (exit_code=0) [production]
21:27 <jiji@cumin2002> START - Cookbook sre.mediawiki.restart-appservers [production]