401-450 of 10000 results (25ms)
2021-01-20 ยง
20:45 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2337.codfw.wmnet [production]
20:45 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2335.codfw.wmnet [production]
20:44 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2333.codfw.wmnet [production]
20:44 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2331.codfw.wmnet [production]
20:41 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc-gp2001.codfw.wmnet [production]
20:41 <effie> restart mc-gp2001, mc-gp2002, mc-gp2003 for T269596 [production]
20:31 <brennen@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.27 (duration: 03m 05s) [production]
20:28 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.27 [production]
20:23 <brennen> 1.36.0-wmf.27 (T271341) train: proceeding to group1 [production]
20:21 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:17 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•’๐Ÿต sudo cumin A:cp 'disable-puppet "cdanis deploying I558346d T272330"' [production]
20:16 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
20:12 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:06 <brennen> 1.36.0-wmf.27 (T271341) train status as of deploy window: currently blocked at group0 on T272508 [production]
20:06 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
19:50 <bblack> lvs1015: bringing pybal back online [production]
19:47 <bblack> lvs1015: stopping pybal to try to fix a lingering ifup service state issue on the host, which may require downing an interface [production]
19:33 <urbanecm@deploy1001> Synchronized static/images/project-logos: 5c941678ec739dd6b5257b4a8f866b7e3a257f45: Revert: [enwiki] Update celebration logo to "option A" (T272526) (duration: 01m 04s) [production]
19:24 <effie> depool and repool thumbor* to upgrade python-thumbor-wikimedia to v2.9 [production]
19:24 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2337.codfw.wmnet with reason: REIMAGE [production]
19:22 <urbanecm@deploy1001> Synchronized static/images/project-logos: 13fb338249b3ec73e380c4971ee697f28a2f6d76: [enwiki] Update celebration logo to "option A" (T272526) (duration: 01m 05s) [production]
19:22 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2335.codfw.wmnet with reason: REIMAGE [production]
19:20 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2333.codfw.wmnet with reason: REIMAGE [production]
19:19 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2337.codfw.wmnet with reason: REIMAGE [production]
19:18 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2331.codfw.wmnet with reason: REIMAGE [production]
19:18 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2335.codfw.wmnet with reason: REIMAGE [production]
19:17 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2333.codfw.wmnet with reason: REIMAGE [production]
19:16 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2331.codfw.wmnet with reason: REIMAGE [production]
19:12 <urbanecm@deploy1001> Synchronized wmf-config/config/kuwiki.yaml: a736d97463e7a42b41dbcff19a8c2c3c62f8bf6d: Enable visualeditor on kuwiki by default (T270841; 2/2) (duration: 01m 05s) [production]
19:11 <XioNoX> add BGP to Lumen in eqiad [production]
19:11 <urbanecm@deploy1001> Synchronized dblists/visualeditor-nondefault.dblist: a736d97463e7a42b41dbcff19a8c2c3c62f8bf6d: Enable visualeditor on kuwiki by default (T270841; 1/2) (duration: 01m 04s) [production]
18:54 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2325.codfw.wmnet [production]
18:53 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2327.codfw.wmnet [production]
18:53 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2329.codfw.wmnet [production]
18:53 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2316.codfw.wmnet [production]
18:51 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2329.codfw.wmnet [production]
18:51 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2327.codfw.wmnet [production]
18:51 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2325.codfw.wmnet [production]
18:51 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2316.codfw.wmnet [production]
18:42 <brennen@deploy1001> Synchronized php-1.36.0-wmf.27/extensions/AbuseFilter/includes/View/AbuseFilterViewDiff.php: Backport: [[gerrit:657366|Catch ClosestFilterVersionNotFoundException in ViewDiff (T272505)]] (duration: 01m 06s) [production]
18:29 <bblack> lvs1015: re-enabling puppet + pybal - T272258 [production]
18:25 <XioNoX> draining esams-eqiad link [production]
18:24 <mutante> ganeti - creating 150G virtual hard disk and adding it to releases2002 for T272092 [production]
18:22 <mutante> ganeti - creating 105G virtual harddisk and adding to releases1002 for T272092 [production]
18:17 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on mw2327.codfw.wmnet with reason: new install on buster [production]
18:17 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on mw2327.codfw.wmnet with reason: new install on buster [production]
18:15 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw2327.codfw.wmnet with reason: REIMAGE [production]
18:14 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2329.codfw.wmnet with reason: REIMAGE [production]
18:12 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2325.codfw.wmnet with reason: REIMAGE [production]
18:10 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2329.codfw.wmnet with reason: REIMAGE [production]