1-50 of 10000 results (20ms)
2021-04-06 ยง
23:36 <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.37/resources/src/: b8a0dabb1599dfd3fc08c878a5f23f7e7fce08e9: Fix missing styles on diff (T279099) (duration: 01m 08s) [production]
23:16 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 997b6f35b544f2ae7339c4c62d303b980c307c3a: thwikisource: Enable transwiki import (T275281) (duration: 01m 08s) [production]
23:04 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 4d12a8672f0f930cec75fc2fc42abc8899d93088: Disable upcoming DiscussionTools features for now (duration: 01m 08s) [production]
19:49 <dduvall@deploy1002> Pruned MediaWiki: 1.36.0-wmf.36 (duration: 01m 50s) [production]
19:47 <dduvall@deploy1002> Pruned MediaWiki: 1.36.0-wmf.35 (duration: 02m 02s) [production]
19:45 <dduvall@deploy1002> Pruned MediaWiki: 1.36.0-wmf.34 (duration: 03m 37s) [production]
19:40 <marxarelli> 1.36.0-wmf.38 rolled to group0. error rates steady and no new errors spotted (T278344) [production]
19:26 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.38 [production]
18:41 <dduvall@deploy1002> Finished scap: testwikis wikis to 1.36.0-wmf.38 (duration: 33m 31s) [production]
18:20 <Urbanecm> [urbanecm@mwmaint1002 ~/uploads]$ mwscript importImages.php --wiki=commonswiki --comment-ext=txt --sleep=3600 --user=Sturm . # T278856 [production]
18:18 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp2036.codfw.wmnet [production]
18:18 <bblack> cp2036 - re-pooling via confctl [production]
18:14 <bblack> dns2001 - re-enabling and running puppet agent to restore service [production]
18:10 <dduvall@deploy1002> Started scap: testwikis wikis to 1.36.0-wmf.38 [production]
18:07 <andrew@deploy1002> Finished deploy [horizon/deploy@392708e]: Updating Horizon to 'main' to see if that works around T279465 (duration: 04m 10s) [production]
18:03 <andrew@deploy1002> Started deploy [horizon/deploy@392708e]: Updating Horizon to 'main' to see if that works around T279465 [production]
17:51 <bblack> dns2001 - manually disabled puppet and stopped pdns-recursor.service (and thus implicitly BIRD) to manual-depool due to switch port issues [production]
17:49 <bblack> cp2036 - explicitly confctl-depooled due to switch issues [production]
17:48 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp2036.codfw.wmnet [production]
17:05 <andrew@deploy1002> Finished deploy [horizon/deploy@df2b0b4]: Upgrade to Horizon/Wallaby (take two) (duration: 03m 30s) [production]
17:02 <andrew@deploy1002> Started deploy [horizon/deploy@df2b0b4]: Upgrade to Horizon/Wallaby (take two) [production]
16:28 <andrew@deploy1002> Finished deploy [horizon/deploy@df2b0b4]: Upgrade to Horizon/Wallaby (duration: 04m 32s) [production]
16:23 <andrew@deploy1002> Started deploy [horizon/deploy@df2b0b4]: Upgrade to Horizon/Wallaby [production]
16:16 <krinkle@deploy1002> Synchronized php-1.36.0-wmf.37/skins/Vector/: I3234e7712b8c1 (duration: 01m 01s) [production]
15:49 <Urbanecm> Start server-side upload for 3 video files (T279189, T279188, T279183) [production]
15:31 <marostegui@cumin1001> dbctl commit (dc=all): 'db1163 (re)pooling @ 100%: Repool db1163', diff saved to https://phabricator.wikimedia.org/P15182 and previous config saved to /var/cache/conftool/dbconfig/20210406-153123-root.json [production]
15:16 <marostegui@cumin1001> dbctl commit (dc=all): 'db1163 (re)pooling @ 75%: Repool db1163', diff saved to https://phabricator.wikimedia.org/P15180 and previous config saved to /var/cache/conftool/dbconfig/20210406-151619-root.json [production]
15:03 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on sretest1002.eqiad.wmnet with reason: bullseye tests [production]
15:03 <jmm@cumin2001> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on sretest1002.eqiad.wmnet with reason: bullseye tests [production]
15:01 <marostegui@cumin1001> dbctl commit (dc=all): 'db1163 (re)pooling @ 50%: Repool db1163', diff saved to https://phabricator.wikimedia.org/P15179 and previous config saved to /var/cache/conftool/dbconfig/20210406-150115-root.json [production]
14:46 <marostegui@cumin1001> dbctl commit (dc=all): 'db1163 (re)pooling @ 25%: Repool db1163', diff saved to https://phabricator.wikimedia.org/P15178 and previous config saved to /var/cache/conftool/dbconfig/20210406-144612-root.json [production]
14:31 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 97 hosts with reason: upgrading openstack [production]
14:31 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on 97 hosts with reason: upgrading openstack [production]
14:30 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 9 hosts with reason: upgrading openstack [production]
14:30 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on 9 hosts with reason: upgrading openstack [production]
14:29 <dcaro> populated thirdparty/ceph-octopus buster repo with reprepro (T274566) [production]
14:22 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1002.eqiad.wmnet [production]
14:18 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host sretest1002.eqiad.wmnet [production]
13:57 <moritzm> upgrading sretest1002 to bullseye [production]
13:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1163 for schema change', diff saved to https://phabricator.wikimedia.org/P15177 and previous config saved to /var/cache/conftool/dbconfig/20210406-134418-marostegui.json [production]
13:37 <Urbanecm> Retrying server-side upload for 1 file (T279192) [production]
13:20 <Urbanecm> Start server-side upload for 4 video files (T279191, T279192, T279193, T279190) [production]
12:46 <marostegui@cumin1001> dbctl commit (dc=all): 'db1164 (re)pooling @ 100%: Repool db1164', diff saved to https://phabricator.wikimedia.org/P15176 and previous config saved to /var/cache/conftool/dbconfig/20210406-124614-root.json [production]
12:43 <jayme@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:43 <jayme@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
12:42 <jayme@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
12:42 <jayme@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
12:31 <marostegui@cumin1001> dbctl commit (dc=all): 'db1164 (re)pooling @ 75%: Repool db1164', diff saved to https://phabricator.wikimedia.org/P15175 and previous config saved to /var/cache/conftool/dbconfig/20210406-123111-root.json [production]
12:28 <moritzm> installing netty security updates [production]
12:16 <marostegui@cumin1001> dbctl commit (dc=all): 'db1164 (re)pooling @ 50%: Repool db1164', diff saved to https://phabricator.wikimedia.org/P15174 and previous config saved to /var/cache/conftool/dbconfig/20210406-121607-root.json [production]