2351-2400 of 10000 results (51ms)
2022-04-05 ยง
20:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:48 <urbanecm> UTC late B&C window done [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:47 <mutante> puppetmaster1001 - running test downloads of geoip databases to a temp dir [production]
20:47 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: 8ea86349017e71dcd38bde0663cfb13e86fe127c: Change upload dialog automatic upload comments (T305303) (duration: 00m 54s) [production]
20:44 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:41 <razzi> deploying refinery for https://gerrit.wikimedia.org/r/c/analytics/refinery/+/776269/ [production]
20:39 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:38 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:35 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6013.drmrs.wmnet [production]
20:33 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 10c16c5ed46014ec6f5e771f84320441974bef6c: [config]: Undeploy GDI survey from EN,FR and ES wikis in PROD (T303962) (duration: 00m 55s) [production]
20:32 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:31 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:31 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:27 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp6013.drmrs.wmnet [production]
20:14 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6012.drmrs.wmnet [production]
20:13 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
20:13 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
20:13 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24132 and previous config saved to /var/cache/conftool/dbconfig/20220405-201315-ladsgroup.json [production]
20:05 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp6012.drmrs.wmnet [production]
19:58 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P24131 and previous config saved to /var/cache/conftool/dbconfig/20220405-195810-ladsgroup.json [production]
19:55 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6011.drmrs.wmnet [production]
19:49 <rzl@cumin2002> conftool action : set/pooled=no; selector: cluster=videoscaler,name=mw(1307|1308|1309|1310|1311|1318|1334|1335|1336|1337).* [production]
19:46 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp6011.drmrs.wmnet [production]
19:43 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P24130 and previous config saved to /var/cache/conftool/dbconfig/20220405-194305-ladsgroup.json [production]
19:36 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6010.drmrs.wmnet [production]
19:29 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp6010.drmrs.wmnet [production]
19:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24129 and previous config saved to /var/cache/conftool/dbconfig/20220405-192800-ladsgroup.json [production]
19:16 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6009.drmrs.wmnet [production]
19:08 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp6009.drmrs.wmnet [production]
18:50 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6006.drmrs.wmnet [production]
18:47 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mwlog1002.eqiad.wmnet [production]
18:42 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp6006.drmrs.wmnet [production]
18:42 <herron@cumin1001> START - Cookbook sre.hosts.reboot-single for host mwlog1002.eqiad.wmnet [production]
18:41 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mwlog2002.codfw.wmnet [production]
18:37 <herron@cumin1001> START - Cookbook sre.hosts.reboot-single for host mwlog2002.codfw.wmnet [production]
18:34 <rzl> rzl@apt1001:~$ sudo -i reprepro -C main include bullseye-wikimedia /home/rzl/httpbb/bullseye/httpbb_0.0.1-1+deb11u1_amd64.changes [production]
18:31 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6005.drmrs.wmnet [production]
18:28 <rzl> rzl@apt1001:~$ sudo -i reprepro -C main include buster-wikimedia /home/rzl/httpbb/buster/httpbb_0.0.1-1_amd64.changes # T299705 [production]
18:28 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=parse2015.codfw.wmnet [production]
18:28 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=parse2016.codfw.wmnet [production]
18:25 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=parse2017.codfw.wmnet [production]
18:24 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=parse2018.codfw.wmnet [production]
18:24 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp6005.drmrs.wmnet [production]
18:24 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=parse2019.codfw.wmnet [production]
18:23 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=codfw,name=parse2015.codfw.wmnet [production]