301-350 of 10000 results (28ms)
2021-04-07 §
06:28 <moritzm> restarting apache/FPM on mw canaries to pick up curl updates [production]
06:24 <marostegui@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 100%: Repool db1135 after schema change', diff saved to https://phabricator.wikimedia.org/P15195 and previous config saved to /var/cache/conftool/dbconfig/20210407-062451-root.json [production]
06:15 <marostegui@cumin1001> dbctl commit (dc=all): 'es1020 (re)pooling @ 75%: Repool es1020', diff saved to https://phabricator.wikimedia.org/P15194 and previous config saved to /var/cache/conftool/dbconfig/20210407-061529-root.json [production]
06:09 <marostegui@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 75%: Repool db1135 after schema change', diff saved to https://phabricator.wikimedia.org/P15193 and previous config saved to /var/cache/conftool/dbconfig/20210407-060948-root.json [production]
06:00 <marostegui@cumin1001> dbctl commit (dc=all): 'es1020 (re)pooling @ 50%: Repool es1020', diff saved to https://phabricator.wikimedia.org/P15192 and previous config saved to /var/cache/conftool/dbconfig/20210407-060026-root.json [production]
05:54 <moritzm> installing curl security updates [production]
05:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 50%: Repool db1135 after schema change', diff saved to https://phabricator.wikimedia.org/P15191 and previous config saved to /var/cache/conftool/dbconfig/20210407-055444-root.json [production]
05:45 <marostegui@cumin1001> dbctl commit (dc=all): 'es1020 (re)pooling @ 25%: Repool es1020', diff saved to https://phabricator.wikimedia.org/P15190 and previous config saved to /var/cache/conftool/dbconfig/20210407-054522-root.json [production]
05:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es1020 for upgrade', diff saved to https://phabricator.wikimedia.org/P15189 and previous config saved to /var/cache/conftool/dbconfig/20210407-054127-marostegui.json [production]
05:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db1135 (re)pooling @ 25%: Repool db1135 after schema change', diff saved to https://phabricator.wikimedia.org/P15188 and previous config saved to /var/cache/conftool/dbconfig/20210407-053940-root.json [production]
05:29 <marostegui@cumin1001> dbctl commit (dc=all): 'es1020 (re)pooling @ 25%: Repool es1020', diff saved to https://phabricator.wikimedia.org/P15187 and previous config saved to /var/cache/conftool/dbconfig/20210407-052901-root.json [production]
05:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es1020 for upgrade', diff saved to https://phabricator.wikimedia.org/P15186 and previous config saved to /var/cache/conftool/dbconfig/20210407-050758-marostegui.json [production]
05:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1135 for schema change', diff saved to https://phabricator.wikimedia.org/P15185 and previous config saved to /var/cache/conftool/dbconfig/20210407-050530-marostegui.json [production]
03:28 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2408.codfw.wmnet with reason: REIMAGE [production]
03:26 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2408.codfw.wmnet with reason: REIMAGE [production]
03:19 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2407.codfw.wmnet with reason: REIMAGE [production]
03:17 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2407.codfw.wmnet with reason: REIMAGE [production]
02:20 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2406.codfw.wmnet with reason: REIMAGE [production]
02:18 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2406.codfw.wmnet with reason: REIMAGE [production]
02:05 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2405.codfw.wmnet with reason: REIMAGE [production]
02:03 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2405.codfw.wmnet with reason: REIMAGE [production]
01:53 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2404.codfw.wmnet with reason: REIMAGE [production]
01:51 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2404.codfw.wmnet with reason: REIMAGE [production]
01:46 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cloudcephmon2004-dev.codfw.wmnet with reason: REIMAGE [production]
01:44 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephmon2004-dev.codfw.wmnet with reason: REIMAGE [production]
01:41 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2403.codfw.wmnet with reason: REIMAGE [production]
01:39 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2403.codfw.wmnet with reason: REIMAGE [production]
01:11 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2402.codfw.wmnet with reason: REIMAGE [production]
01:09 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2402.codfw.wmnet with reason: REIMAGE [production]
01:03 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2401.codfw.wmnet with reason: REIMAGE [production]
01:01 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2401.codfw.wmnet with reason: REIMAGE [production]
00:45 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2400.codfw.wmnet with reason: REIMAGE [production]
00:43 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2400.codfw.wmnet with reason: REIMAGE [production]
00:38 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2399.codfw.wmnet with reason: REIMAGE [production]
00:36 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2399.codfw.wmnet with reason: REIMAGE [production]
00:12 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2398.codfw.wmnet with reason: REIMAGE [production]
00:10 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2398.codfw.wmnet with reason: REIMAGE [production]
00:06 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2397.codfw.wmnet with reason: REIMAGE [production]
00:04 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2397.codfw.wmnet with reason: REIMAGE [production]
2021-04-06 §
23:36 <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.37/resources/src/: b8a0dabb1599dfd3fc08c878a5f23f7e7fce08e9: Fix missing styles on diff (T279099) (duration: 01m 08s) [production]
23:16 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 997b6f35b544f2ae7339c4c62d303b980c307c3a: thwikisource: Enable transwiki import (T275281) (duration: 01m 08s) [production]
23:04 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 4d12a8672f0f930cec75fc2fc42abc8899d93088: Disable upcoming DiscussionTools features for now (duration: 01m 08s) [production]
19:49 <dduvall@deploy1002> Pruned MediaWiki: 1.36.0-wmf.36 (duration: 01m 50s) [production]
19:47 <dduvall@deploy1002> Pruned MediaWiki: 1.36.0-wmf.35 (duration: 02m 02s) [production]
19:45 <dduvall@deploy1002> Pruned MediaWiki: 1.36.0-wmf.34 (duration: 03m 37s) [production]
19:40 <marxarelli> 1.36.0-wmf.38 rolled to group0. error rates steady and no new errors spotted (T278344) [production]
19:26 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.38 [production]
18:41 <dduvall@deploy1002> Finished scap: testwikis wikis to 1.36.0-wmf.38 (duration: 33m 31s) [production]
18:20 <Urbanecm> [urbanecm@mwmaint1002 ~/uploads]$ mwscript importImages.php --wiki=commonswiki --comment-ext=txt --sleep=3600 --user=Sturm . # T278856 [production]
18:18 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp2036.codfw.wmnet [production]