251-300 of 10000 results (82ms)
2024-05-23 ยง
23:11 <zabe@deploy1002> zabe: Continuing with sync [production]
23:10 <zabe@deploy1002> zabe: Backport for [[gerrit:1032586|Deploy configuration for wrapping B type passwords with encrypted Argon2 (T112359)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:08 <zabe@deploy1002> Started scap: Backport for [[gerrit:1032586|Deploy configuration for wrapping B type passwords with encrypted Argon2 (T112359)]] [production]
23:00 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1238 (re)pooling @ 25%: Maint over', diff saved to https://phabricator.wikimedia.org/P63040 and previous config saved to /var/cache/conftool/dbconfig/20240523-230005-ladsgroup.json [production]
22:57 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P63039 and previous config saved to /var/cache/conftool/dbconfig/20240523-225730-marostegui.json [production]
22:54 <eileen> tools upgraded from bce5f52b to 91893e29 [production]
22:45 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1238 (re)pooling @ 10%: Maint over', diff saved to https://phabricator.wikimedia.org/P63038 and previous config saved to /var/cache/conftool/dbconfig/20240523-224459-ladsgroup.json [production]
22:43 <zabe@deploy1002> Finished scap: Backport for [[gerrit:1034919|Stop writing to af_user(_text)/afh_user(_text) in group0 wikis (T337920)]] (duration: 18m 39s) [production]
22:42 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P63037 and previous config saved to /var/cache/conftool/dbconfig/20240523-224222-marostegui.json [production]
22:30 <zabe@deploy1002> zabe: Continuing with sync [production]
22:27 <zabe@deploy1002> zabe: Backport for [[gerrit:1034919|Stop writing to af_user(_text)/afh_user(_text) in group0 wikis (T337920)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:27 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214 (T364299)', diff saved to https://phabricator.wikimedia.org/P63036 and previous config saved to /var/cache/conftool/dbconfig/20240523-222714-marostegui.json [production]
22:26 <eileen> civicrm upgraded from 72aa5118 to 6c1fdd4f [production]
22:24 <zabe@deploy1002> Started scap: Backport for [[gerrit:1034919|Stop writing to af_user(_text)/afh_user(_text) in group0 wikis (T337920)]] [production]
22:11 <eileen> civicrm upgraded from 22a38356 to 72aa5118 [production]
21:52 <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] (duration: 18m 01s) [production]
21:46 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2214 (T364299)', diff saved to https://phabricator.wikimedia.org/P63035 and previous config saved to /var/cache/conftool/dbconfig/20240523-214614-marostegui.json [production]
21:46 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2214.codfw.wmnet with reason: Maintenance [production]
21:45 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2214.codfw.wmnet with reason: Maintenance [production]
21:40 <thcipriani@deploy1002> thcipriani and bd808: Continuing with sync [production]
21:37 <thcipriani@deploy1002> thcipriani and bd808: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:34 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] [production]
21:29 <eileen> civicrm upgraded from 55cb3cf7 to 22a38356 [production]
21:26 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:18 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:14 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:14 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:11 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
21:10 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
21:10 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T364299)', diff saved to https://phabricator.wikimedia.org/P63034 and previous config saved to /var/cache/conftool/dbconfig/20240523-211044-marostegui.json [production]
20:59 <eileen> civicrm upgraded from de92d6bc to 55cb3cf7 [production]
20:55 <jsn@deploy1002> Finished scap: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] (duration: 16m 23s) [production]
20:55 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P63033 and previous config saved to /var/cache/conftool/dbconfig/20240523-205536-marostegui.json [production]
20:44 <jsn@deploy1002> jdlrobson and jsn: Continuing with sync [production]
20:42 <jsn@deploy1002> jdlrobson and jsn: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:40 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P63032 and previous config saved to /var/cache/conftool/dbconfig/20240523-204028-marostegui.json [production]
20:39 <jsn@deploy1002> Started scap: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] [production]
20:36 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
20:36 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
20:25 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T364299)', diff saved to https://phabricator.wikimedia.org/P63031 and previous config saved to /var/cache/conftool/dbconfig/20240523-202520-marostegui.json [production]
20:24 <jsn@deploy1002> Finished scap: Backport for [[gerrit:1034131|CommonSettings: Load AutoModerator extension (T361643)]], [[gerrit:1034132|InitialiseSettings: testwiki enable AutoModerator (T361643)]] (duration: 17m 30s) [production]
20:24 <cdanis@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
20:23 <cdanis@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
20:21 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
20:20 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
20:12 <jsn@deploy1002> jsn: Continuing with sync [production]
20:09 <jsn@deploy1002> jsn: Backport for [[gerrit:1034131|CommonSettings: Load AutoModerator extension (T361643)]], [[gerrit:1034132|InitialiseSettings: testwiki enable AutoModerator (T361643)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:08 <bd808@deploy1002> helmfile [eqiad] DONE helmfile.d/services/toolhub: apply [production]
20:07 <bd808@deploy1002> helmfile [eqiad] START helmfile.d/services/toolhub: apply [production]
20:06 <jsn@deploy1002> Started scap: Backport for [[gerrit:1034131|CommonSettings: Load AutoModerator extension (T361643)]], [[gerrit:1034132|InitialiseSettings: testwiki enable AutoModerator (T361643)]] [production]