4701-4750 of 10000 results (112ms)
2024-05-23 ยง
21:40 <thcipriani@deploy1002> thcipriani and bd808: Continuing with sync [production]
21:37 <thcipriani@deploy1002> thcipriani and bd808: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:34 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:1035576|wikitech: (Un)block GitLab accounts when (un)blocked on wikitech (T316418)]] [production]
21:29 <eileen> civicrm upgraded from 55cb3cf7 to 22a38356 [production]
21:26 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:18 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:14 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
21:14 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
21:11 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
21:10 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
21:10 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T364299)', diff saved to https://phabricator.wikimedia.org/P63034 and previous config saved to /var/cache/conftool/dbconfig/20240523-211044-marostegui.json [production]
20:59 <eileen> civicrm upgraded from de92d6bc to 55cb3cf7 [production]
20:55 <jsn@deploy1002> Finished scap: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] (duration: 16m 23s) [production]
20:55 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P63033 and previous config saved to /var/cache/conftool/dbconfig/20240523-205536-marostegui.json [production]
20:44 <jsn@deploy1002> jdlrobson and jsn: Continuing with sync [production]
20:42 <jsn@deploy1002> jdlrobson and jsn: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:40 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P63032 and previous config saved to /var/cache/conftool/dbconfig/20240523-204028-marostegui.json [production]
20:39 <jsn@deploy1002> Started scap: Backport for [[gerrit:1034584|Always use desktop watchlist HTML on mobile (T109277)]] [production]
20:36 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
20:36 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
20:25 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T364299)', diff saved to https://phabricator.wikimedia.org/P63031 and previous config saved to /var/cache/conftool/dbconfig/20240523-202520-marostegui.json [production]
20:24 <jsn@deploy1002> Finished scap: Backport for [[gerrit:1034131|CommonSettings: Load AutoModerator extension (T361643)]], [[gerrit:1034132|InitialiseSettings: testwiki enable AutoModerator (T361643)]] (duration: 17m 30s) [production]
20:24 <cdanis@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
20:23 <cdanis@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
20:21 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
20:20 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
20:12 <jsn@deploy1002> jsn: Continuing with sync [production]
20:09 <jsn@deploy1002> jsn: Backport for [[gerrit:1034131|CommonSettings: Load AutoModerator extension (T361643)]], [[gerrit:1034132|InitialiseSettings: testwiki enable AutoModerator (T361643)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:08 <bd808@deploy1002> helmfile [eqiad] DONE helmfile.d/services/toolhub: apply [production]
20:07 <bd808@deploy1002> helmfile [eqiad] START helmfile.d/services/toolhub: apply [production]
20:06 <jsn@deploy1002> Started scap: Backport for [[gerrit:1034131|CommonSettings: Load AutoModerator extension (T361643)]], [[gerrit:1034132|InitialiseSettings: testwiki enable AutoModerator (T361643)]] [production]
20:06 <bd808@deploy1002> helmfile [codfw] DONE helmfile.d/services/toolhub: apply [production]
20:05 <bd808@deploy1002> helmfile [codfw] START helmfile.d/services/toolhub: apply [production]
20:05 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host kafka-main1010.eqiad.wmnet with OS bullseye [production]
20:04 <bd808@deploy1002> helmfile [staging] DONE helmfile.d/services/toolhub: apply [production]
20:04 <bd808@deploy1002> helmfile [staging] START helmfile.d/services/toolhub: apply [production]
19:47 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2193 (T364299)', diff saved to https://phabricator.wikimedia.org/P63030 and previous config saved to /var/cache/conftool/dbconfig/20240523-194723-marostegui.json [production]
19:47 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2193.codfw.wmnet with reason: Maintenance [production]
19:47 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2193.codfw.wmnet with reason: Maintenance [production]
19:47 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T364299)', diff saved to https://phabricator.wikimedia.org/P63029 and previous config saved to /var/cache/conftool/dbconfig/20240523-194659-marostegui.json [production]
19:38 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
19:38 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
19:31 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P63028 and previous config saved to /var/cache/conftool/dbconfig/20240523-193152-marostegui.json [production]
19:16 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P63027 and previous config saved to /var/cache/conftool/dbconfig/20240523-191644-marostegui.json [production]
19:01 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T364299)', diff saved to https://phabricator.wikimedia.org/P63026 and previous config saved to /var/cache/conftool/dbconfig/20240523-190136-marostegui.json [production]
18:55 <cdanis@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
18:55 <cdanis@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
18:55 <cdanis@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
18:54 <cdanis@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
18:48 <cdanis> T365626 helmfile destroy'd all opentelemetry-collector releases [production]