2301-2350 of 10000 results (41ms)
2021-04-12 §
08:07 <jiji@cumin1001> conftool action : set/pooled=no; selector: cluster=videoscaler,name=mw1311.eqiad.wmnet [production]
08:06 <jiji@cumin1001> conftool action : set/pooled=no; selector: cluster=videoscaler,name=mw1318.eqiad.wmnet [production]
08:06 <jiji@cumin1001> conftool action : set/pooled=no; selector: cluster=videoscaler,name=mw1334.eqiad.wmnet [production]
08:05 <vgutierrez> restart acme-chief [production]
2021-04-10 §
14:21 <andrew@deploy1002> Finished deploy [horizon/deploy@ee1be56]: fix for T279699 (duration: 04m 12s) [production]
14:17 <andrew@deploy1002> Started deploy [horizon/deploy@ee1be56]: fix for T279699 [production]
14:11 <andrew@deploy1002> Finished deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 (duration: 02m 21s) [production]
14:08 <andrew@deploy1002> Started deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 [production]
14:08 <andrew@deploy1002> Finished deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 (duration: 00m 11s) [production]
14:08 <andrew@deploy1002> Started deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 [production]
2021-04-09 §
14:07 <jynus> retry es4 backup dump on eqiad (backup1002) [production]
01:25 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on moss-be2002.codfw.wmnet with reason: REIMAGE [production]
01:23 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on moss-be2002.codfw.wmnet with reason: REIMAGE [production]
00:56 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on moss-be2001.codfw.wmnet with reason: REIMAGE [production]
00:54 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on moss-be2001.codfw.wmnet with reason: REIMAGE [production]
00:49 <legoktm> imported mailman3 backports on apt.wm.o (T278905) [production]
2021-04-08 §
23:48 <brennen@deploy1002> Synchronized php-1.36.0-wmf.38/extensions/WikibaseMediaInfo/resources/mediasearch-vue/store/actions.js: Backport: [[gerrit:677956|Do not show "invalid search" message when request is aborted by user (TT277714)]] (duration: 00m 57s) [production]
22:12 <tgr@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
22:12 <tgr@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
22:00 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1046.eqiad.wmnet with reason: REIMAGE [production]
21:57 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1045.eqiad.wmnet with reason: REIMAGE [production]
21:56 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1046.eqiad.wmnet with reason: REIMAGE [production]
21:55 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1044.eqiad.wmnet with reason: REIMAGE [production]
21:54 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1045.eqiad.wmnet with reason: REIMAGE [production]
21:53 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1043.eqiad.wmnet with reason: REIMAGE [production]
21:52 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1044.eqiad.wmnet with reason: REIMAGE [production]
21:51 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1043.eqiad.wmnet with reason: REIMAGE [production]
21:50 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1042.eqiad.wmnet with reason: REIMAGE [production]
21:48 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1041.eqiad.wmnet with reason: REIMAGE [production]
21:48 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1042.eqiad.wmnet with reason: REIMAGE [production]
21:47 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1041.eqiad.wmnet with reason: REIMAGE [production]
21:46 <tgr@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
21:46 <tgr@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
21:38 <andrew@deploy1002> Finished deploy [horizon/deploy@3abe9d0]: Fix for T279667 (duration: 03m 52s) [production]
21:34 <andrew@deploy1002> Started deploy [horizon/deploy@3abe9d0]: Fix for T279667 [production]
21:33 <tgr@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
20:33 <mutante> mw2403 through mw2411 pooled and set to active state in netbox (T279599) [production]
20:32 <mutante> mw2304 through mw2411 - pooled and set to active state in netbox (T279599) [production]
20:30 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw240[3-9].codfw.wmnet [production]
20:28 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw241[0-1].codfw.wmnet [production]
20:27 <legoktm> legoktm@deploy1002:~$ cat deb-parsoid-urls.txt | mwscript purgeList.php --wiki=aawiki # to clear releases.wm.o/debian/ cache [production]
20:02 <legoktm> imported parsoid_0.11.1all_all.deb to releases.wikimedia.org apt repo [production]
19:58 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw241[0-1].codfw.wmnet [production]
19:58 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw241[0-1].codfw.wmnet [production]
19:57 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw238[0-2].codfw.wmnet [production]
19:56 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw2379.codfw.wmnet [production]
19:55 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw240[3-9].codfw.wmnet [production]
19:54 <dzahn@cumin1001> conftool action : set/weight=30; selector: name=mw240[3-9].codfw.wmnet [production]
19:50 <mutante> mw2403 through mw2411 - scap pull - new hardware [production]
19:35 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.38 [production]