801-850 of 10000 results (62ms)
2020-02-06 ยง
20:30 <twentyafterfour> sync-wikiversions --force [production]
20:30 <twentyafterfour@deploy1001> Scap failed!: 9/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
20:25 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.18 refs T233866 [production]
19:45 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T244405 Set wgLogoHD before adding wordmark (duration: 01m 06s) [production]
19:36 <bblack> re-pool cp1075 (eqiad text) [production]
19:33 <addshore> SWAT done! [production]
19:32 <addshore@deploy1001> Synchronized php-1.35.0-wmf.18/extensions/WikibaseLexemeCirrusSearch: T244479 Update namespace for PrefetchingTermLookup & fix tests (duration: 01m 06s) [production]
19:31 <bblack> depool cp1075 (eqiad text) for minor experimentation [production]
19:29 <addshore@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/Babel/includes/Babel.php: T243713 Timeout for meta api call from 10 to 2 seconds. (duration: 01m 07s) [production]
19:28 <addshore@deploy1001> Synchronized php-1.35.0-wmf.18/extensions/Babel/includes/Babel.php: T243713 Timeout for meta api call from 10 to 2 seconds. (duration: 01m 07s) [production]
19:25 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Fix incorrect spellings of "RESTBase" in config variables (2/2) 2.IS (duration: 01m 06s) [production]
19:23 <addshore@deploy1001> Synchronized wmf-config/CommonSettings.php: Fix incorrect spellings of "RESTBase" in config variables (2/2) 1.CS (duration: 01m 07s) [production]
19:23 <cdanis> manual puppet run on netflow1001 looked good; โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•‘โ˜• sudo cumin A:netflow "run-puppet-agent --enable 'rollout of I60692f0e8 T237587 cdanis'" [production]
19:22 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:20 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Fix incorrect spellings of "RESTBase" in config variables (1/2) (duration: 01m 06s) [production]
19:20 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
19:14 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable EntitySourceBasedFederation everywhere T243395, sync again for luck (duration: 01m 06s) [production]
19:12 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•‘โ˜• sudo cumin A:netflow "disable-puppet 'rollout of I60692f0e8 T237587 cdanis'" [production]
19:10 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable EntitySourceBasedFederation everywhere T243395 (duration: 01m 07s) [production]
19:05 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable EntitySourceBasedFederation for group1 T243395 (duration: 01m 10s) [production]
19:01 <moritzm> restarting exim on mendelevium to pick up cyrus-sasl security updates [production]
18:58 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:56 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
18:55 <moritzm> restarting apache on tungsten/dbmonitor to pick up cyrus-sasl security updates [production]
18:53 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@8e15868]: Update mobileapps to ceeb950 (duration: 06m 27s) [production]
18:46 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@8e15868]: Update mobileapps to ceeb950 [production]
18:36 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:34 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
18:06 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:04 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
17:32 <herron> set performance cpu scaling governor on maps* [production]
16:49 <vgutierrez> pooling ncredir5002 running buster - T243391 [production]
16:38 <vgutierrez> pooling cp4023 with buster - T242093 [production]
16:36 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@524be2b]: airflow: Update ores data transfer from drafttopic -> articletopic (duration: 00m 19s) [production]
16:35 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@524be2b]: airflow: Update ores data transfer from drafttopic -> articletopic [production]
16:35 <XioNoX> remove AS prepending in esams/knams [production]
16:31 <bblack> lvs1013 - restart pybal for dual bgp session config - T180069 [production]
16:30 <bblack> lvs1014 - restart pybal for dual bgp session config - T180069 [production]
16:30 <bblack> lvs1015 - restart pybal for dual bgp session config - T180069 [production]
16:29 <bblack> lvs1016 - restart pybal for dual bgp session config - T180069 [production]
16:28 <moritzm> restarting apache on bromine to pick up SASL security updates [production]
16:24 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:22 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:22 <moritzm> installing cyrus-sasl2 security updates on jessie [production]
16:20 <bblack> lvs2001 - restart pybal for dual bgp session config - T180069 [production]
16:19 <bblack> lvs2002 - restart pybal for dual bgp session config - T180069 [production]
16:19 <bblack> lvs2003 - restart pybal for dual bgp session config - T180069 [production]
16:07 <vgutierrez> depool and reimage ncredir5002 as buster - T243391 [production]
16:07 <bblack> lvs4005 - restart pybal for dual bgp session config - T180069 [production]
16:06 <bblack> lvs4006 - restart pybal for dual bgp session config - T180069 [production]