2018-07-31
§
|
10:40 |
<akosiaris@deploy1001> |
scap-helm mathoid cluster codfw completed |
[production] |
10:39 |
<akosiaris@deploy1001> |
scap-helm mathoid cluster eqiad completed |
[production] |
10:39 |
<akosiaris@deploy1001> |
scap-helm mathoid upgrade production stable/mathoid [namespace: mathoid, clusters: eqiad,codfw] |
[production] |
09:46 |
<ema> |
reboot cp1045 (jessie) for kernel updates |
[production] |
09:29 |
<ema> |
upload varnishkafka 1.0.13-1 to stretch-wikimedia T200445 T186250 |
[production] |
08:44 |
<jynus> |
stop and reimage db1104 to stretch |
[production] |
08:17 |
<akosiaris> |
repool mathoid codfw in discovery, the kubernetes upgrade is done |
[production] |
08:08 |
<akosiaris> |
upgrade kubernetes2004 to 1.9.9 |
[production] |
08:05 |
<akosiaris> |
upgrade kubernetes2003 to 1.9.9 |
[production] |
08:00 |
<akosiaris> |
upgrade kubernetes2002 to 1.9.9 |
[production] |
07:55 |
<ema> |
reboot cp2018 for kernel updates |
[production] |
07:54 |
<moritzm> |
reboot cp1008 for kernel tests |
[production] |
07:53 |
<akosiaris> |
upgrade kubernetes2001 to 1.9.9 |
[production] |
07:50 |
<ema> |
reboot cp2025 for kernel updates |
[production] |
07:47 |
<akosiaris> |
upgrade acrux.codfw.wmnet to kubernetes 1.9.9 |
[production] |
07:44 |
<jynus> |
stopping db1118 mariadb and starting mysql there |
[production] |
07:36 |
<moritzm> |
reboot multatuli for kernel tests |
[production] |
07:35 |
<akosiaris> |
upgrade acrab.codfw.wmnet to kubernetes 1.9.9 |
[production] |
07:32 |
<moritzm> |
run decomission_appserver on terbium |
[production] |
07:27 |
<akosiaris> |
backup kubetcd2001 etcd data before kubernetes upgrade |
[production] |
07:24 |
<akosiaris> |
depool codfw mathoid from discovery for kubernetes upgrade |
[production] |
07:10 |
<moritzm> |
installing mutt security updates |
[production] |
07:05 |
<marostegui> |
Remove unused and old grants from codfw hosts - T146149#4456082 |
[production] |
06:49 |
<jynus> |
dropping unnecesary tendril web users from tendril db backends |
[production] |
06:45 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool row B es hosts, reduce db1089 load (duration: 00m 49s) |
[production] |
06:11 |
<moritzm> |
installing ant security updates |
[production] |
05:01 |
<marostegui> |
Deploy schema change on db1099:3318 T144010 T51190 T199368 |
[production] |
05:00 |
<marostegui> |
Deploy schema change on dbstore1002:s8 T144010 T51190 T199368/script unload irssinotifier |
[production] |
04:54 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool all hosts in row B - T183585 (duration: 00m 50s) |
[production] |
04:47 |
<marostegui> |
Stop change_tag_def populate maintenance script for wikidata and enwiki - T193873 |
[production] |
02:37 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Tue Jul 31 02:37:40 UTC 2018 (duration 10m 20s) |
[production] |
02:27 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.14) (duration: 08m 12s) |
[production] |
01:20 |
<ejegg> |
updated payments-wiki from 344233cff8 to 6afaca3de3 |
[production] |
00:44 |
<thcipriani@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:447572|Switch in WebM VP9/Opus video transcodes to replace WebM VP8/Vorbis]] T63805 (duration: 00m 48s) |
[production] |
00:39 |
<thcipriani@deploy1001> |
Finished scap: SWAT: [[gerrit:449260|Convert to extension.json]] T87981 [[gerrit:449372|Use maps for wgEnabledTranscodeSet]] T118080 [[gerrit:449373|Adjust VP9 encoding for speed, quality]] [[gerrit:449374|More conservative max bitrate for VP9 video transcodes]] (duration: 33m 44s) |
[production] |
00:07 |
<ejegg> |
updated payments-wiki from 8c4d6aaa13 to 344233cff8 |
[production] |
00:05 |
<thcipriani@deploy1001> |
Started scap: SWAT: [[gerrit:449260|Convert to extension.json]] T87981 [[gerrit:449372|Use maps for wgEnabledTranscodeSet]] T118080 [[gerrit:449373|Adjust VP9 encoding for speed, quality]] [[gerrit:449374|More conservative max bitrate for VP9 video transcodes]] |
[production] |
2018-07-30
§
|
23:35 |
<XioNoX> |
re-enabling puppet on cp40* - T195365 |
[production] |
23:27 |
<thcipriani@deploy1001> |
Synchronized php-1.32.0-wmf.14/extensions/RevisionSlider/modules: SWAT: [[gerrit:449198|RevisionSlider: Fix missing pin icon]] T200263 (duration: 00m 49s) |
[production] |
23:15 |
<thcipriani@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:448146|Enable Special:Block Feedback Request (2)]] T199919 (duration: 00m 49s) |
[production] |
22:35 |
<XioNoX> |
applying static route + fixed MTU to cp4025 - T195365 |
[production] |
22:29 |
<XioNoX> |
- puppet disabled on cp40* hosts - T195365 |
[production] |
22:10 |
<thcipriani> |
restarting jenkins after plugin updates |
[production] |
21:55 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@10e3207]: Updating go-import plugin (cobalt) (duration: 00m 10s) |
[production] |
21:55 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@10e3207]: Updating go-import plugin (cobalt) |
[production] |
21:51 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@10e3207]: Updating go-import plugin (gerrit2001 only) (duration: 00m 09s) |
[production] |
21:51 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@10e3207]: Updating go-import plugin (gerrit2001 only) |
[production] |
21:01 |
<ebernhardson@deploy1001> |
Finished deploy [search/mjolnir/deploy@debb5b0]: Update spark.yaml with latest training configuration (duration: 04m 12s) |
[production] |
20:56 |
<ebernhardson@deploy1001> |
Started deploy [search/mjolnir/deploy@debb5b0]: Update spark.yaml with latest training configuration |
[production] |
20:41 |
<ebernhardson@deploy1001> |
Finished deploy [search/mjolnir/deploy@69ac0d5]: fix wrong yaml import in cli entry point (duration: 02m 30s) |
[production] |