2018-12-27
§
|
18:04 |
<mobrovac@deploy1001> |
deploy aborted: Fix rate-limiter crash (with increased deploy delays) - T212631 (duration: 00m 09s) |
[production] |
18:04 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a67f38e]: Fix rate-limiter crash (with increased deploy delays) - T212631 |
[production] |
18:03 |
<mobrovac@deploy1001> |
deploy aborted: Fix rate-limiter crash - T212631 (duration: 13m 09s) |
[production] |
17:50 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@70c4752]: Fix rate-limiter crash - T212631 |
[production] |
17:20 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@ae7a537]: Fix rate-limiter crash - T212631 - deploy only on canary restbase1007 (duration: 04m 24s) |
[production] |
17:15 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@ae7a537]: Fix rate-limiter crash - T212631 - deploy only on canary restbase1007 |
[production] |
16:00 |
<cmjohnson1> |
powercycling frdb1001 for troubleshooting |
[production] |
15:21 |
<bawolff> |
Updated interwiki cache https://biblio.wiki to https://wikilivres.org -> T212650 |
[production] |
15:19 |
<bawolff@deploy1001> |
Synchronized wmf-config/interwiki.php: Updating interwiki cache (duration: 03m 34s) |
[production] |
04:26 |
<bd808> |
Shutdown striker-deploy03 instance for T204563 |
[striker] |
01:55 |
<Krinkle> |
Upgrade CVNBot18 to CVNBot 1.22.0-beta.1 (latest master, xbuild, cvn-app8) |
[cvn] |
01:38 |
<Cam11598> |
restarted cvnbot18 had no response for over 30000 seconds |
[cvn] |
00:24 |
<bd808> |
Promoted striker-deploy04 to active deploy server |
[striker] |
2018-12-26
§
|
18:47 |
<Jayprakash12345> |
Setup cronjob to run script every 6 hours (T212517) |
[tools.indic-wsstats] |
18:46 |
<Jayprakash12345> |
Setup cronjob to run script every 6 hours |
[tools.indic-wsstats] |
18:46 |
<Jayprakash12345> |
tools-bastion-03:~/www/python/src$ git pull (Updating to 7c4c24e) (T212517) |
[tools.indic-wsstats] |
16:37 |
<godog> |
clear logstash persistent queue /var/lib/logstash on logstash100[789] |
[production] |
15:47 |
<godog> |
roll-restart logstash on logstash100[789] |
[production] |
14:26 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=wtp1028.eqiad.wmnet |
[production] |
14:18 |
<godog> |
powercycle wtp1028 - nothing on console |
[production] |
09:13 |
<godog> |
swift eqiad-prod: more weight for ms-be10[44-50].eqiad.wmnet - T209618 |
[production] |
07:20 |
<marostegui> |
Fix replication db1124:3318 |
[production] |
2018-12-22
§
|
18:47 |
<elukey> |
manually clean up of old log files on an-coord1001 (disk space issues) |
[analytics] |
18:45 |
<elukey> |
manually clean up of old log files on an-coord1001 (disk space issues) |
[production] |
15:58 |
<godog> |
reboot ms-be2018, stuck on sd 0:1:0:1: rejecting I/O to offline device |
[production] |
13:30 |
<Hauskatze> |
github: deleting https://github.com/wikimedia/labs-tools-signpost mirror | T212559 |
[releng] |
10:21 |
<cwd> |
re-enabled process-control |
[production] |
08:36 |
<cwd> |
took down sidebar fr campaign |
[production] |
08:36 |
<cwd> |
disabled process-control |
[production] |
01:00 |
<AaronSchulz> |
Deployed b47e9fcfece99 to navtiming |
[production] |
00:59 |
<aaron@deploy1001> |
Finished deploy [performance/navtiming@b47e9fc]: (no justification provided) (duration: 00m 05s) |
[production] |
00:59 |
<aaron@deploy1001> |
Started deploy [performance/navtiming@b47e9fc]: (no justification provided) |
[production] |