2019-02-27
§
|
16:20 |
<volans> |
force-rebooting icinga1001 (to test some puppet changes) - T214760 |
[production] |
15:34 |
<jbond42> |
rolling openssl security updates to jessie canary servers |
[production] |
14:25 |
<marostegui> |
Deploy schema change on abuse_filter_log on s7 codfw - lag will be generated on codfw - T187295 |
[production] |
14:01 |
<marostegui> |
Change indexes on abuse_filter_log on db1089 - T187295 |
[production] |
14:00 |
<moritzm> |
uploaded openssl 1.0.2r to jessie-wikimedia |
[production] |
12:08 |
<jbond42> |
correction: rolling updates of apache on mw api servers *not* jobrunners |
[production] |
12:04 |
<jbond42> |
rolling updates of apache on mw jobrunners |
[production] |
11:38 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1077 after MySQL upgrade (duration: 00m 53s) |
[production] |
11:28 |
<godog> |
cleanup log4j from lvs eqiad / ipvsadm -D -t logstash.svc.eqiad.wmnet:4560 |
[production] |
11:25 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Give more traffic to db1077 after MySQL upgrade (duration: 00m 54s) |
[production] |
11:17 |
<godog> |
roll-restart pybal after removing logstash log4j service |
[production] |
10:54 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Give more traffic to db1077 after MySQL upgrade (duration: 00m 54s) |
[production] |
10:35 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1077 with low weight after MySQL upgrade (duration: 00m 53s) |
[production] |
09:55 |
<marostegui> |
Stop MySQL on db1077 for mysql upgrade - this will generate lag on labsdb:s3 |
[production] |
09:55 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1077 for MySQL upgrade (duration: 00m 53s) |
[production] |
09:50 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1082 (duration: 00m 54s) |
[production] |
09:35 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool in API db1082 after mysql upgrade (duration: 00m 53s) |
[production] |
09:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1082 after mysql upgrade (duration: 00m 54s) |
[production] |
09:05 |
<marostegui> |
Stop MySQL on db1082 for mysql upgrade |
[production] |
08:41 |
<godog> |
enable mmjsonparse by default on kafka outputs - T213189 |
[production] |
08:40 |
<marostegui> |
Deploy schema change on db1082 - will generate lag on labsdb:s5 - T86342 |
[production] |
08:40 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1082 for mysql upgrade (duration: 00m 54s) |
[production] |
08:26 |
<marostegui> |
Retroactive log, T216444 Global rename of Дагиров Умар → Takhirgeran Umar was done by alanajjar |
[production] |
08:02 |
<marostegui> |
Global rename of HeavyTony → QTHCCAN by alanajjar - T217222 |
[production] |
07:01 |
<marostegui> |
Deploy schema change on s5 codfw master (db2052), this will generate lag on codfw - T86342 |
[production] |
06:30 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1076 (duration: 00m 55s) |
[production] |
06:12 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1076 (duration: 01m 08s) |
[production] |
05:05 |
<kart_> |
Finished manual run of unpublished ContentTranslation draft purge script (T216983) |
[production] |
04:58 |
<SMalyshev> |
repooled wdqs1006 |
[production] |
03:09 |
<kart_> |
Manual run of unpublished ContentTranslation draft purge script (T216983) |
[production] |
00:38 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/CirrusSearch-common.php: [cirrus] decrease regex timeouts by 25% and drop timeout hack (duration: 00m 53s) |
[production] |
00:30 |
<ebernhardson@deploy1001> |
Synchronized php-1.33.0-wmf.19/skins/MinervaNeue/resources/skins.minerva.scripts/errorLogging.js: MinervaNeue: Allow us to distinguish errors for logged in users (duration: 00m 53s) |
[production] |
00:30 |
<bd808> |
Re-enabled puppet on labweb100[12] |
[production] |
00:23 |
<bd808> |
Disabled puppet on labweb100[12] |
[production] |
00:15 |
<bd808> |
Manually changed logging level and restarted Horizon on labweb100[12] |
[production] |
00:15 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [cirrus] autocomplete: enable subphrase matching for officewiki (2/2) (duration: 00m 54s) |
[production] |
00:14 |
<ebernhardson@deploy1001> |
sync-file aborted: (no justification provided) (duration: 00m 01s) |
[production] |
00:07 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [cirrus] autocomplete: enable subphrase suggester builds on officewiki (1/2) (duration: 00m 54s) |
[production] |
00:03 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: noop sync for labs files gerrit:493103 (duration: 00m 54s) |
[production] |
2019-02-26
§
|
23:39 |
<tgr> |
T217203 running mwscript ~/fixStuckGlobalRename.php --wiki=metawiki --logwiki=metawiki 'LaurenceKingPublishing' 'Fiona at Laurence King Publishing' |
[production] |
23:37 |
<tgr> |
T217203 running mwscript ~/fixStuckGlobalRename.php --wiki=metawiki --logwiki=metawiki 'Citycarclubfi' 'Urbaanimies' |
[production] |
23:16 |
<SMalyshev> |
depooled wdqs1006 to see if it's catch up |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics cluster staging completed |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics upgrade -f eventgate-analytics-staging-values.yaml staging stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics cluster eqiad completed |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics upgrade -f eventgate-analytics-eqiad-values.yaml production stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
22:43 |
<akosiaris@deploy1001> |
scap-helm eventgate-analytics cluster codfw completed |
[production] |