7251-7300 of 10000 results (114ms)
2024-05-24 §
00:43 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217 (T364299)', diff saved to https://phabricator.wikimedia.org/P63048 and previous config saved to /var/cache/conftool/dbconfig/20240524-004342-marostegui.json [production]
00:28 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P63047 and previous config saved to /var/cache/conftool/dbconfig/20240524-002834-marostegui.json [production]
00:13 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P63046 and previous config saved to /var/cache/conftool/dbconfig/20240524-001326-marostegui.json [production]
2024-05-23 §
23:58 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217 (T364299)', diff saved to https://phabricator.wikimedia.org/P63045 and previous config saved to /var/cache/conftool/dbconfig/20240523-235817-marostegui.json [production]
23:30 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1238 (re)pooling @ 100%: Maint over', diff saved to https://phabricator.wikimedia.org/P63044 and previous config saved to /var/cache/conftool/dbconfig/20240523-233017-ladsgroup.json [production]
23:24 <zabe@deploy1002> Finished scap: Backport for [[gerrit:1032586|Deploy configuration for wrapping B type passwords with encrypted Argon2 (T112359)]] (duration: 16m 00s) [production]
23:15 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1238 (re)pooling @ 75%: Maint over', diff saved to https://phabricator.wikimedia.org/P63043 and previous config saved to /var/cache/conftool/dbconfig/20240523-231511-ladsgroup.json [production]
23:13 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2217 (T364299)', diff saved to https://phabricator.wikimedia.org/P63042 and previous config saved to /var/cache/conftool/dbconfig/20240523-231302-marostegui.json [production]
23:12 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2217.codfw.wmnet with reason: Maintenance [production]
23:12 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2217.codfw.wmnet with reason: Maintenance [production]
23:12 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214 (T364299)', diff saved to https://phabricator.wikimedia.org/P63041 and previous config saved to /var/cache/conftool/dbconfig/20240523-231238-marostegui.json [production]
23:11 <zabe@deploy1002> zabe: Continuing with sync [production]
23:10 <zabe@deploy1002> zabe: Backport for [[gerrit:1032586|Deploy configuration for wrapping B type passwords with encrypted Argon2 (T112359)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:08 <zabe@deploy1002> Started scap: Backport for [[gerrit:1032586|Deploy configuration for wrapping B type passwords with encrypted Argon2 (T112359)]] [production]
23:00 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1238 (re)pooling @ 25%: Maint over', diff saved to https://phabricator.wikimedia.org/P63040 and previous config saved to /var/cache/conftool/dbconfig/20240523-230005-ladsgroup.json [production]
22:57 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P63039 and previous config saved to /var/cache/conftool/dbconfig/20240523-225730-marostegui.json [production]
22:54 <eileen> tools upgraded from bce5f52b to 91893e29 [production]
22:45 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1238 (re)pooling @ 10%: Maint over', diff saved to https://phabricator.wikimedia.org/P63038 and previous config saved to /var/cache/conftool/dbconfig/20240523-224459-ladsgroup.json [production]
22:43 <zabe@deploy1002> Finished scap: Backport for [[gerrit:1034919|Stop writing to af_user(_text)/afh_user(_text) in group0 wikis (T337920)]] (duration: 18m 39s) [production]
22:42 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P63037 and previous config saved to /var/cache/conftool/dbconfig/20240523-224222-marostegui.json [production]
22:30 <zabe@deploy1002> zabe: Continuing with sync [production]
22:27 <zabe@deploy1002> zabe: Backport for [[gerrit:1034919|Stop writing to af_user(_text)/afh_user(_text) in group0 wikis (T337920)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:27 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214 (T364299)', diff saved to https://phabricator.wikimedia.org/P63036 and previous config saved to /var/cache/conftool/dbconfig/20240523-222714-marostegui.json [production]
22:26 <eileen> civicrm upgraded from 72aa5118 to 6c1fdd4f [production]
22:24 <zabe@deploy1002> Started scap: Backport for [[gerrit:1034919|Stop writing to af_user(_text)/afh_user(_text) in group0 wikis (T337920)]] [production]
22:11 <eileen> civicrm upgraded from 22a38356 to 72aa5118 [production]
21:52 <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] (duration: 18m 01s) [production]
21:46 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2214 (T364299)', diff saved to https://phabricator.wikimedia.org/P63035 and previous config saved to /var/cache/conftool/dbconfig/20240523-214614-marostegui.json [production]
21:46 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2214.codfw.wmnet with reason: Maintenance [production]
21:45 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2214.codfw.wmnet with reason: Maintenance [production]
21:40 <thcipriani@deploy1002> thcipriani and bd808: Continuing with sync [production]
21:37 <thcipriani@deploy1002> thcipriani and bd808: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:34 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] [production]
21:29 <eileen> civicrm upgraded from 55cb3cf7 to 22a38356 [production]
21:26 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:18 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:14 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:14 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:11 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
21:10 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
21:10 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T364299)', diff saved to https://phabricator.wikimedia.org/P63034 and previous config saved to /var/cache/conftool/dbconfig/20240523-211044-marostegui.json [production]
20:59 <eileen> civicrm upgraded from de92d6bc to 55cb3cf7 [production]
20:55 <jsn@deploy1002> Finished scap: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] (duration: 16m 23s) [production]
20:55 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P63033 and previous config saved to /var/cache/conftool/dbconfig/20240523-205536-marostegui.json [production]
20:44 <jsn@deploy1002> jdlrobson and jsn: Continuing with sync [production]
20:42 <jsn@deploy1002> jdlrobson and jsn: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:40 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P63032 and previous config saved to /var/cache/conftool/dbconfig/20240523-204028-marostegui.json [production]
20:39 <jsn@deploy1002> Started scap: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] [production]
20:36 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
20:36 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]