651-700 of 10000 results (37ms)
2021-04-10 §
14:17 <andrew@deploy1002> Started deploy [horizon/deploy@ee1be56]: fix for T279699 [production]
14:11 <andrew@deploy1002> Finished deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 (duration: 02m 21s) [production]
14:08 <andrew@deploy1002> Started deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 [production]
14:08 <andrew@deploy1002> Finished deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 (duration: 00m 11s) [production]
14:08 <andrew@deploy1002> Started deploy [horizon/deploy@ee1be56]: cloudweb2001-dev deploy partial fix for T279699 [production]
2021-04-09 §
14:07 <jynus> retry es4 backup dump on eqiad (backup1002) [production]
01:25 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on moss-be2002.codfw.wmnet with reason: REIMAGE [production]
01:23 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on moss-be2002.codfw.wmnet with reason: REIMAGE [production]
00:56 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on moss-be2001.codfw.wmnet with reason: REIMAGE [production]
00:54 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on moss-be2001.codfw.wmnet with reason: REIMAGE [production]
00:49 <legoktm> imported mailman3 backports on apt.wm.o (T278905) [production]
2021-04-08 §
23:48 <brennen@deploy1002> Synchronized php-1.36.0-wmf.38/extensions/WikibaseMediaInfo/resources/mediasearch-vue/store/actions.js: Backport: [[gerrit:677956|Do not show "invalid search" message when request is aborted by user (TT277714)]] (duration: 00m 57s) [production]
22:12 <tgr@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
22:12 <tgr@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
22:00 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1046.eqiad.wmnet with reason: REIMAGE [production]
21:57 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1045.eqiad.wmnet with reason: REIMAGE [production]
21:56 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1046.eqiad.wmnet with reason: REIMAGE [production]
21:55 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1044.eqiad.wmnet with reason: REIMAGE [production]
21:54 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1045.eqiad.wmnet with reason: REIMAGE [production]
21:53 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1043.eqiad.wmnet with reason: REIMAGE [production]
21:52 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1044.eqiad.wmnet with reason: REIMAGE [production]
21:51 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1043.eqiad.wmnet with reason: REIMAGE [production]
21:50 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1042.eqiad.wmnet with reason: REIMAGE [production]
21:48 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1041.eqiad.wmnet with reason: REIMAGE [production]
21:48 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1042.eqiad.wmnet with reason: REIMAGE [production]
21:47 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1041.eqiad.wmnet with reason: REIMAGE [production]
21:46 <tgr@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
21:46 <tgr@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
21:38 <andrew@deploy1002> Finished deploy [horizon/deploy@3abe9d0]: Fix for T279667 (duration: 03m 52s) [production]
21:34 <andrew@deploy1002> Started deploy [horizon/deploy@3abe9d0]: Fix for T279667 [production]
21:33 <tgr@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
20:33 <mutante> mw2403 through mw2411 pooled and set to active state in netbox (T279599) [production]
20:32 <mutante> mw2304 through mw2411 - pooled and set to active state in netbox (T279599) [production]
20:30 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw240[3-9].codfw.wmnet [production]
20:28 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw241[0-1].codfw.wmnet [production]
20:27 <legoktm> legoktm@deploy1002:~$ cat deb-parsoid-urls.txt | mwscript purgeList.php --wiki=aawiki # to clear releases.wm.o/debian/ cache [production]
20:02 <legoktm> imported parsoid_0.11.1all_all.deb to releases.wikimedia.org apt repo [production]
19:58 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw241[0-1].codfw.wmnet [production]
19:58 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw241[0-1].codfw.wmnet [production]
19:57 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw238[0-2].codfw.wmnet [production]
19:56 <dzahn@cumin1001> conftool action : set/weight=10; selector: name=mw2379.codfw.wmnet [production]
19:55 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw240[3-9].codfw.wmnet [production]
19:54 <dzahn@cumin1001> conftool action : set/weight=30; selector: name=mw240[3-9].codfw.wmnet [production]
19:50 <mutante> mw2403 through mw2411 - scap pull - new hardware [production]
19:35 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.38 [production]
18:52 <phuedx> phuedx@deploy1002 Synchronized private/PrivateSettings.php: PrivateSettings: Add value for $wgWMEVectorPrefDiffSalt (T261842) [production]
18:51 <phuedx@deploy1002> Synchronized private/PrivateSettings.php: PrivateSettings: Add value for (T261842) (duration: 01m 06s) [production]
18:37 <mutante> mw2403 through mw2411 - serial rebooting [production]
18:31 <tgr@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
18:31 <tgr@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]