5251-5300 of 10000 results (67ms)
2022-06-30 ยง
20:23 <bd808@deploy1002> helmfile [eqiad] START helmfile.d/services/toolhub: apply [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:22 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:21 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:19 <bd808@deploy1002> helmfile [codfw] DONE helmfile.d/services/toolhub: apply [production]
20:18 <bd808@deploy1002> helmfile [codfw] START helmfile.d/services/toolhub: apply [production]
20:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:17 <bd808@deploy1002> helmfile [staging] DONE helmfile.d/services/toolhub: apply [production]
20:16 <bd808@deploy1002> helmfile [staging] START helmfile.d/services/toolhub: apply [production]
20:14 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:806960]] QuickSurveys: Deploy research-incentive to jawiki [production]
19:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1169 (T309311)', diff saved to https://phabricator.wikimedia.org/P30692 and previous config saved to /var/cache/conftool/dbconfig/20220630-193254-ladsgroup.json [production]
19:32 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
19:32 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
19:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132 (T309311)', diff saved to https://phabricator.wikimedia.org/P30691 and previous config saved to /var/cache/conftool/dbconfig/20220630-193223-ladsgroup.json [production]
19:17 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132', diff saved to https://phabricator.wikimedia.org/P30690 and previous config saved to /var/cache/conftool/dbconfig/20220630-191718-ladsgroup.json [production]
19:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132', diff saved to https://phabricator.wikimedia.org/P30689 and previous config saved to /var/cache/conftool/dbconfig/20220630-190213-ladsgroup.json [production]
18:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132 (T309311)', diff saved to https://phabricator.wikimedia.org/P30688 and previous config saved to /var/cache/conftool/dbconfig/20220630-184708-ladsgroup.json [production]
18:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1179 (T307525)', diff saved to https://phabricator.wikimedia.org/P30687 and previous config saved to /var/cache/conftool/dbconfig/20220630-184530-ladsgroup.json [production]
18:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1179', diff saved to https://phabricator.wikimedia.org/P30686 and previous config saved to /var/cache/conftool/dbconfig/20220630-183025-ladsgroup.json [production]
18:21 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
18:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
18:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
18:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1179', diff saved to https://phabricator.wikimedia.org/P30685 and previous config saved to /var/cache/conftool/dbconfig/20220630-181520-ladsgroup.json [production]
18:15 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.39.0-wmf.18 refs T308071 [production]
18:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1179 (T307525)', diff saved to https://phabricator.wikimedia.org/P30684 and previous config saved to /var/cache/conftool/dbconfig/20220630-180015-ladsgroup.json [production]
17:46 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1132 (T309311)', diff saved to https://phabricator.wikimedia.org/P30683 and previous config saved to /var/cache/conftool/dbconfig/20220630-174603-ladsgroup.json [production]
17:45 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1132.eqiad.wmnet with reason: Maintenance [production]
17:45 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1132.eqiad.wmnet with reason: Maintenance [production]
17:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1184 (T309311)', diff saved to https://phabricator.wikimedia.org/P30682 and previous config saved to /var/cache/conftool/dbconfig/20220630-174532-ladsgroup.json [production]
17:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1179 (T307525)', diff saved to https://phabricator.wikimedia.org/P30681 and previous config saved to /var/cache/conftool/dbconfig/20220630-174043-ladsgroup.json [production]
17:40 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance [production]
17:40 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance [production]
17:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1184', diff saved to https://phabricator.wikimedia.org/P30680 and previous config saved to /var/cache/conftool/dbconfig/20220630-173027-ladsgroup.json [production]
17:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1184', diff saved to https://phabricator.wikimedia.org/P30679 and previous config saved to /var/cache/conftool/dbconfig/20220630-171522-ladsgroup.json [production]
17:10 <mbsantos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
17:09 <mbsantos@deploy1002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
17:07 <mbsantos@deploy1002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
17:07 <mbsantos@deploy1002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
17:06 <mbsantos@deploy1002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
17:06 <mbsantos@deploy1002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
17:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1184 (T309311)', diff saved to https://phabricator.wikimedia.org/P30678 and previous config saved to /var/cache/conftool/dbconfig/20220630-170016-ladsgroup.json [production]
16:32 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:28 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
16:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1184 (T309311)', diff saved to https://phabricator.wikimedia.org/P30676 and previous config saved to /var/cache/conftool/dbconfig/20220630-160831-ladsgroup.json [production]
16:08 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1184.eqiad.wmnet with reason: Maintenance [production]
16:08 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1184.eqiad.wmnet with reason: Maintenance [production]
15:43 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T307525)', diff saved to https://phabricator.wikimedia.org/P30675 and previous config saved to /var/cache/conftool/dbconfig/20220630-154335-ladsgroup.json [production]
15:43 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host stat1010.eqiad.wmnet with OS bullseye [production]
15:31 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2156.codfw.wmnet with OS bullseye [production]