4101-4150 of 10000 results (67ms)
2022-06-30 ยง
23:57 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2164.mgmt.codfw.wmnet with reboot policy FORCED [production]
23:54 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2164.mgmt.codfw.wmnet with reboot policy FORCED [production]
23:48 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db2164.mgmt.codfw.wmnet with reboot policy FORCED [production]
23:42 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2164.mgmt.codfw.wmnet with reboot policy FORCED [production]
23:42 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2163.mgmt.codfw.wmnet with reboot policy FORCED [production]
23:42 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2161.mgmt.codfw.wmnet with reboot policy FORCED [production]
23:39 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db2162.mgmt.codfw.wmnet with reboot policy FORCED [production]
22:54 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2162.mgmt.codfw.wmnet with reboot policy FORCED [production]
22:53 <pt1979@cumin2002> START - Cookbook sre.hosts.provision for host db2161.mgmt.codfw.wmnet with reboot policy FORCED [production]
22:39 <cjming> end of UTC late backport and config training window [production]
22:34 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:30 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
22:28 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:809961|QuickSurveys: Enable 'research-incentive' survey on 'jawiki' (T311015)]] (duration: 03m 40s) [production]
22:27 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
22:26 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
22:26 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
22:25 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
22:23 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:810099|Vector: Deploy title above tabs to all opt-in wikis (T310054)]] (duration: 03m 36s) [production]
22:20 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
22:17 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
22:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
22:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
22:13 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:810109|Enable grid on beta cluster (T303484)]] (duration: 03m 43s) [production]
22:06 <thcipriani@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:810063|[wmf-config]: Deploy GDI Survey 2 on EN and FA wikis (T311759)]] (duration: 03m 16s) [production]
21:56 <thcipriani@deploy1002> Synchronized portals: Config: [[gerrit:810077|Bumping portals to master (T128546)]] (duration: 03m 34s) [production]
21:55 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:55 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:53 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:53 <thcipriani@deploy1002> Synchronized portals/wikipedia.org/assets: Config: [[gerrit:810077|Bumping portals to master (T128546)]] (duration: 03m 24s) [production]
21:48 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:47 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:46 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:41 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:40 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:34 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:33 <thcipriani@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:810060|tawikisource: Add English alias for Author/Author_talk namespace (T165813)]] (duration: 03m 42s) [production]
21:33 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:33 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:32 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T309311)', diff saved to https://phabricator.wikimedia.org/P30696 and previous config saved to /var/cache/conftool/dbconfig/20220630-212558-ladsgroup.json [production]
21:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P30695 and previous config saved to /var/cache/conftool/dbconfig/20220630-211053-ladsgroup.json [production]
21:07 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:06 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:05 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:59 <thcipriani@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:809165|Enable Wikistories on idwiki (T311143)]] (duration: 03m 31s) [production]