|
2017-02-21
ยง
|
| 19:32 |
<demon@tin> |
Started scap: prime wmf.13 - testwiki plus l10n build (pt 3 because ugh) |
[production] |
| 19:32 |
<demon@tin> |
scap failed: RuntimeError 2 test canaries had check failures (rerun with --force to override this check) (duration: 15m 00s) |
[production] |
| 19:17 |
<demon@tin> |
Started scap: prime wmf.13 - testwiki plus l10n build (pt 2 because T156851) |
[production] |
| 19:16 |
<demon@tin> |
Finished scap: prime wmf.13 - testwiki plus l10n build (duration: 26m 15s) |
[production] |
| 18:49 |
<demon@tin> |
Started scap: prime wmf.13 - testwiki plus l10n build |
[production] |
| 18:45 |
<moritzm> |
installing PHP security updates on iridium (phabricator.wikimedia.org) |
[production] |
| 18:36 |
<ppchelko@tin> |
Finished deploy [changeprop/deploy@4706f9d]: Change-Prop: Make ORES return minified responses T157693 (duration: 00m 55s) |
[production] |
| 18:35 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@4706f9d]: Change-Prop: Make ORES return minified responses T157693 |
[production] |
| 18:34 |
<Pchelolo> |
changeprop deploy 4706f9da |
[production] |
| 18:14 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic10(27|32|34|38|41).eqiad.wmnet |
[production] |
| 18:12 |
<godog> |
roll-restart nodepool on labnodepool1001 to pick up statsd.eqiad.wmnet DNS changes - T157022 |
[production] |
| 18:12 |
<godog> |
roll-restart zuul on cont1001 to pick up statsd.eqiad.wmnet DNS changes - T157022 |
[production] |
| 18:04 |
<godog> |
roll-restart eventstreams in codfw/eqiad to pick up statsd.eqiad.wmnet DNS changes - T157022 |
[production] |
| 18:03 |
<godog> |
roll-restart trendingedits in codfw/eqiad to pick up statsd.eqiad.wmnet DNS changes - T157022 |
[production] |
| 17:58 |
<demon@tin> |
Synchronized tests/multiversion/MWMultiVersionTest.php: No op in prod, completeness, etc (duration: 00m 40s) |
[production] |
| 17:57 |
<demon@tin> |
Synchronized multiversion/MWMultiVersion.php: Shut up dumb invalid hostname errors (duration: 00m 52s) |
[production] |
| 17:50 |
<godog> |
roll-restart ocg in codfw/eqiad to pick up statsd.eqiad.wmnet DNS changes - T157022 |
[production] |
| 17:47 |
<godog> |
roll-restart jmxtrans in codfw/eqiad on conf* to pick up statsd.eqiad.wmnet DNS changes - T157022 |
[production] |
| 17:35 |
<godog> |
roll-restart parsoid in codfw/eqiad to pick up statsd.eqiad.wmnet DNS changes - T157022 |
[production] |
| 17:35 |
<Amir1> |
done restarting ores services |
[production] |
| 17:20 |
<Amir1> |
restarting ores uwsgi and celery services in scb nodes |
[production] |
| 16:59 |
<ema> |
cache_misc, cache_maps: libssl1.1 upgraded to 1.1.0e-1+wmf1, libevent-2.0-5 upgraded to 2.0.21-stable-2+deb8u1 |
[production] |
| 16:37 |
<gehel> |
restarting elasticsearch on elastic1030 |
[production] |
| 16:34 |
<gehel> |
truncating elasticsearch logs on elastic1023 |
[production] |
| 16:31 |
<gehel> |
truncating elasticsearch logs on elastic1030 |
[production] |
| 16:18 |
<dcausse> |
truncated main elastic log, daemon.log and syslog on elastic1023 |
[production] |
| 16:08 |
<moritzm> |
restarting apache on uranium for openssl update |
[production] |
| 16:06 |
<dcausse> |
truncated main log file on elastic1030 |
[production] |
| 15:50 |
<gehel> |
restarting wdqs-updater on wdqs1002 |
[production] |
| 15:40 |
<elukey> |
restart eventlogging on kafka200[123] for openssl upgrades |
[production] |
| 15:40 |
<godog> |
restart navtiming ve asset-check statsd-mw-js-deprecate on hafnium to pick up statsd.eqiad.wmnet change - T157022 |
[production] |
| 15:39 |
<elukey> |
restart jmxtrans on kafka[12]00[123] for T157022 |
[production] |
| 15:34 |
<mobrovac@tin> |
Started restart [mobileapps/deploy@cd3b897]: Restarting for Graphite DNS switch T157022 |
[production] |
| 15:32 |
<elukey> |
correction on my previous entry: restart eventlogging on kafka100[123] for openssl upgrades |
[production] |
| 15:30 |
<mobrovac@tin> |
Started restart [graphoid/deploy@da37386]: Restarting for Graphite DNS switch T157022 |
[production] |
| 15:22 |
<elukey> |
restart eventlogging on kafka200[123] for openssl upgrades |
[production] |
| 15:21 |
<mobrovac@tin> |
Started restart [cxserver/deploy@0e4ae4f]: Restarting for Graphite DNS switch T157022 |
[production] |
| 15:20 |
<moritzm> |
rolling restart of swift frontend servers to pick up openssl update |
[production] |
| 15:19 |
<mobrovac@tin> |
Started restart [citoid/deploy@95df861]: Restarting for Graphite DNS switch T157022 |
[production] |
| 15:18 |
<mobrovac@tin> |
Started restart [mathoid/deploy@ba3217e]: Restarting for Graphite DNS switch T157022 |
[production] |
| 15:17 |
<hashar> |
European SWAT complete |
[production] |
| 15:17 |
<hashar@tin> |
Synchronized php-1.29.0-wmf.12/extensions/UniversalLanguageSelector/UniversalLanguageSelector.hooks.php: Fix site picks: missing from globals (duration: 01m 00s) |
[production] |
| 15:12 |
<gehel> |
restarting kartotherian / tilerator(ui) on maps1* |
[production] |
| 15:09 |
<gehel> |
restarting kartotherian / tilerator(ui) on maps2* |
[production] |
| 15:06 |
<gehel> |
restarting kartotherian / tilerator(ui) on maps-test* |
[production] |
| 15:06 |
<godog> |
roll-restart restbase after statsd move to graphite1001 - T157022 |
[production] |
| 15:06 |
<elukey> |
Increased manually maximum httpd keep alive requests and timeout on bohrium (piwik) - T154558 |
[production] |
| 14:56 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic10(33|34|38|42).eqiad.wmnet |
[production] |
| 14:43 |
<hashar@tin> |
Synchronized php-1.29.0-wmf.12/extensions/UniversalLanguageSelector/maintenance/ULSCompactLinksDisablePref.php: Add a maintenance script for opt-in T133031 (duration: 00m 41s) |
[production] |
| 14:35 |
<moritzm> |
upgrading openssl on logstash cluster / various base service restarts |
[production] |