3101-3150 of 10000 results (76ms)
2024-04-23 ยง
08:57 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2215.codfw.wmnet [production]
08:55 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2206 (re)pooling @ 25%: post maintenance repool', diff saved to https://phabricator.wikimedia.org/P61086 and previous config saved to /var/cache/conftool/dbconfig/20240423-085514-arnaudb.json [production]
08:54 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc2002.wikimedia.org [production]
08:50 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host irc2002.wikimedia.org [production]
08:43 <arnaudb@cumin1002> START - Cookbook sre.hosts.reimage for host db2172.codfw.wmnet with OS bookworm [production]
08:42 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2172.codfw.wmnet with reason: T362746 [production]
08:42 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db2172.codfw.wmnet with reason: T362746 [production]
08:41 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depool db2172', diff saved to https://phabricator.wikimedia.org/P61085 and previous config saved to /var/cache/conftool/dbconfig/20240423-084146-arnaudb.json [production]
08:40 <hashar@deploy1002> Finished scap: Backport for [[gerrit:1023100|ParserOutput: don't complain if TOCHTML is unset from ParserCache (T363107)]] (duration: 16m 13s) [production]
08:40 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2206 (re)pooling @ 10%: post maintenance repool', diff saved to https://phabricator.wikimedia.org/P61084 and previous config saved to /var/cache/conftool/dbconfig/20240423-084008-arnaudb.json [production]
08:33 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2215.codfw.wmnet [production]
08:31 <arnaudb@cumin1002> END (PASS) - Cookbook sre.mysql.upgrade (exit_code=0) for db2206.codfw.wmnet [production]
08:28 <hashar@deploy1002> cscott and hashar: Continuing with sync [production]
08:28 <hashar@deploy1002> cscott and hashar: Backport for [[gerrit:1023100|ParserOutput: don't complain if TOCHTML is unset from ParserCache (T363107)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:28 <arnaudb@cumin1002> START - Cookbook sre.mysql.upgrade for db2206.codfw.wmnet [production]
08:26 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2206.codfw.wmnet with reason: T362746 [production]
08:26 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on db2206.codfw.wmnet with reason: T362746 [production]
08:26 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depool db2206', diff saved to https://phabricator.wikimedia.org/P61083 and previous config saved to /var/cache/conftool/dbconfig/20240423-082621-arnaudb.json [production]
08:24 <hashar@deploy1002> Started scap: Backport for [[gerrit:1023100|ParserOutput: don't complain if TOCHTML is unset from ParserCache (T363107)]] [production]
08:20 <hashar@deploy1002> Sync cancelled. [production]
08:20 <hashar@deploy1002> hashar and cscott: Backport for [[gerrit:1023100|ParserOutput: don't complain if TOCHTML is unset from ParserCache (T363107)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:16 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1002.wikimedia.org [production]
08:15 <hashar@deploy1002> Started scap: Backport for [[gerrit:1023100|ParserOutput: don't complain if TOCHTML is unset from ParserCache (T363107)]] [production]
08:13 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2191.codfw.wmnet [production]
08:12 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host irc1002.wikimedia.org [production]
08:12 <kartik@deploy1002> Finished scap: Backport for [[gerrit:1023148|CX: Initialize publishNamespace for CXTarget (T349959)]] (duration: 44m 53s) [production]
08:05 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2191.codfw.wmnet [production]
08:04 <godog> restore sre business hour escalation policy - T350192 [production]
07:59 <kartik@deploy1002> kartik: Continuing with sync [production]
07:58 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2131.codfw.wmnet [production]
07:42 <kartik@deploy1002> kartik: Backport for [[gerrit:1023148|CX: Initialize publishNamespace for CXTarget (T349959)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:38 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2131.codfw.wmnet [production]
07:37 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
07:37 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
07:36 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T352010)', diff saved to https://phabricator.wikimedia.org/P61082 and previous config saved to /var/cache/conftool/dbconfig/20240423-073658-ladsgroup.json [production]
07:31 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host db2115.codfw.wmnet [production]
07:27 <kartik@deploy1002> Started scap: Backport for [[gerrit:1023148|CX: Initialize publishNamespace for CXTarget (T349959)]] [production]
07:22 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host db2115.codfw.wmnet [production]
07:21 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P61081 and previous config saved to /var/cache/conftool/dbconfig/20240423-072151-ladsgroup.json [production]
07:06 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P61080 and previous config saved to /var/cache/conftool/dbconfig/20240423-070643-ladsgroup.json [production]
06:51 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T352010)', diff saved to https://phabricator.wikimedia.org/P61079 and previous config saved to /var/cache/conftool/dbconfig/20240423-065136-ladsgroup.json [production]
03:47 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2130 (T352010)', diff saved to https://phabricator.wikimedia.org/P61078 and previous config saved to /var/cache/conftool/dbconfig/20240423-034652-ladsgroup.json [production]
03:46 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2130.codfw.wmnet with reason: Maintenance [production]
03:46 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2130.codfw.wmnet with reason: Maintenance [production]
03:46 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2116 (T352010)', diff saved to https://phabricator.wikimedia.org/P61077 and previous config saved to /var/cache/conftool/dbconfig/20240423-034628-ladsgroup.json [production]
03:31 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2116', diff saved to https://phabricator.wikimedia.org/P61076 and previous config saved to /var/cache/conftool/dbconfig/20240423-033120-ladsgroup.json [production]
03:16 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2116', diff saved to https://phabricator.wikimedia.org/P61075 and previous config saved to /var/cache/conftool/dbconfig/20240423-031613-ladsgroup.json [production]
03:05 <mwpresync@deploy1002> Pruned MediaWiki: 1.42.0-wmf.25 (duration: 05m 37s) [production]
03:01 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2116 (T352010)', diff saved to https://phabricator.wikimedia.org/P61074 and previous config saved to /var/cache/conftool/dbconfig/20240423-030106-ladsgroup.json [production]
00:24 <sukhe@cumin2002> dbctl commit (dc=all): 'depool db1246', diff saved to https://phabricator.wikimedia.org/P61073 and previous config saved to /var/cache/conftool/dbconfig/20240423-002413-sukhe.json [production]