9351-9400 of 10000 results (83ms)
2022-05-24 ยง
16:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1161 (T298560)', diff saved to https://phabricator.wikimedia.org/P28455 and previous config saved to /var/cache/conftool/dbconfig/20220524-163221-ladsgroup.json [production]
15:31 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/image-suggestion: apply [production]
15:27 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@644075e]: increase executor jvm heap for convert_to_esbulk (duration: 02m 22s) [production]
15:27 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:25 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@644075e]: increase executor jvm heap for convert_to_esbulk [production]
15:22 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
15:21 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/image-suggestion: apply [production]
15:15 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2029.codfw.wmnet [production]
15:10 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti2029.codfw.wmnet [production]
14:46 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2028.codfw.wmnet [production]
14:39 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti2028.codfw.wmnet [production]
14:03 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2068.codfw.wmnet [production]
14:02 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
14:01 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
14:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
14:00 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:55 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:797221|Revert "Revert read new on frwiki for templatelinks migration"]] (duration: 00m 52s) [production]
13:54 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:52 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:52 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:51 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:50 <ladsgroup@deploy1002> Synchronized php-1.39.0-wmf.12/includes/api/ApiQueryBacklinksprop.php: Backport: [[gerrit:797220|ApiQueryBacklinksprop: Completely remove index hints (T306673)]] (duration: 00m 55s) [production]
13:42 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2068.codfw.wmnet [production]
13:36 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:35 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:29 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:28 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:27 <taavi@deploy1002> Synchronized static/images/project-logos: Config: [[gerrit:793127|zhwikisource: Optimize logo per commons files (T308620)]] (duration: 00m 55s) [production]
13:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:25 <taavi@deploy1002> Synchronized wmf-config/logos.php: Config: [[gerrit:792752|zhwikisource: Declare commons files for logo (T308620)]] (duration: 00m 52s) [production]
13:25 <taavi@deploy1002> Synchronized logos/config.yaml: Config: [[gerrit:792752|zhwikisource: Declare commons files for logo (T308620)]] (duration: 00m 53s) [production]
13:17 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:14 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:14 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:10 <taavi@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:793790|Remove patrol rights from autoconfirmed users and create patroller user group on bnwiki (T308945)]] (duration: 00m 53s) [production]
12:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1118 (T303603)', diff saved to https://phabricator.wikimedia.org/P28452 and previous config saved to /var/cache/conftool/dbconfig/20220524-125331-ladsgroup.json [production]
12:52 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2027.codfw.wmnet [production]
12:46 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti2027.codfw.wmnet [production]
12:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1118', diff saved to https://phabricator.wikimedia.org/P28450 and previous config saved to /var/cache/conftool/dbconfig/20220524-123826-ladsgroup.json [production]
12:36 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2026.codfw.wmnet [production]
12:31 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti2026.codfw.wmnet [production]
12:30 <moritzm> installing openldap security updates [production]
12:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1118', diff saved to https://phabricator.wikimedia.org/P28449 and previous config saved to /var/cache/conftool/dbconfig/20220524-122321-ladsgroup.json [production]
12:22 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2025.codfw.wmnet [production]
12:17 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti2025.codfw.wmnet [production]
12:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1161 (T298560)', diff saved to https://phabricator.wikimedia.org/P28448 and previous config saved to /var/cache/conftool/dbconfig/20220524-121641-ladsgroup.json [production]