1351-1400 of 10000 results (63ms)
2022-03-17 ยง
21:26 <rzl@deploy1002> helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply [production]
21:25 <rzl@deploy1002> helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply [production]
21:25 <rzl@deploy1002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply [production]
21:25 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:25 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:25 <rzl@deploy1002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
21:25 <rzl@deploy1002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
21:24 <rzl@deploy1002> helmfile [staging] START helmfile.d/services/eventgate-analytics-external: apply [production]
21:24 <rzl@deploy1002> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
21:24 <rzl@deploy1002> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
21:24 <rzl@deploy1002> helmfile [staging] DONE helmfile.d/services/blubberoid: apply [production]
21:24 <rzl@deploy1002> helmfile [staging] START helmfile.d/services/blubberoid: apply [production]
21:24 <rzl@deploy1002> helmfile [staging] DONE helmfile.d/services/apertium: apply [production]
21:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:23 <rzl@deploy1002> helmfile [staging] START helmfile.d/services/apertium: apply [production]
21:21 <cjming@deploy1002> Synchronized php-1.38.0-wmf.26/extensions/WikimediaMaintenance/T299104.php: Backport: [[gerrit:771394|Update invalid skin preference update script (T299104)]] (duration: 00m 51s) [production]
21:18 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:17 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:11 <jhuneidi@deploy1002> Synchronized php: group1 wikis to 1.38.0-wmf.26 refs T300202 (duration: 00m 50s) [production]
21:10 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.38.0-wmf.26 refs T300202 [production]
20:57 <ladsgroup@deploy1002> Finished scap: Revert "rdbms: Followups to automatic connection recovery patch" (duration: 11m 50s) [production]
20:46 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:45 <ladsgroup@deploy1002> Started scap: Revert "rdbms: Followups to automatic connection recovery patch" [production]
20:45 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:45 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:44 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:41 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
20:41 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 3 days, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
20:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T300775)', diff saved to https://phabricator.wikimedia.org/P22798 and previous config saved to /var/cache/conftool/dbconfig/20220317-204128-marostegui.json [production]
20:41 <cmjohnson@cumin1001> START - Cookbook sre.hosts.provision for host ml-cache1003.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:40 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:39 <cmjohnson@cumin1001> START - Cookbook sre.hosts.provision for host ml-cache1002.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:39 <cmjohnson@cumin1001> START - Cookbook sre.hosts.provision for host ml-cache1001.mgmt.eqiad.wmnet with reboot policy FORCED [production]
20:35 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
20:33 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:29 <thcipriani@deploy1002> Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:763779|Revert "Enable Parsoid API everywhere" (T302081)]] (duration: 00m 50s) [production]
20:29 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:28 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
20:28 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P22797 and previous config saved to /var/cache/conftool/dbconfig/20220317-202623-marostegui.json [production]
20:26 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:21 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P22796 and previous config saved to /var/cache/conftool/dbconfig/20220317-201118-marostegui.json [production]
20:09 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]