2018-02-13
§
|
09:30 |
<marostegui> |
Stop replication in sync on db1089 and dbstore1002 - T162807 |
[production] |
09:29 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1065 - T162807 (duration: 00m 54s) |
[production] |
09:22 |
<elukey> |
powercycle analytics1062 - not reachable via ssh, frozen via serial console |
[production] |
09:22 |
<jynus> |
disabling puppet on all eqiad databases |
[production] |
09:20 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1065 - T162807 (duration: 00m 55s) |
[production] |
09:20 |
<marostegui> |
Stop replication in sync on db1089 and db1065 - T162807 |
[production] |
09:12 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2084:3315, depool db2075 (duration: 00m 55s) |
[production] |
09:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 - T162807 (duration: 00m 55s) |
[production] |
08:52 |
<marostegui> |
Stop replication in sync on db1089 and db1099:3311 - T162807 |
[production] |
08:51 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1089, db1099 - T162807 (duration: 00m 55s) |
[production] |
08:41 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2084:3315 (duration: 00m 56s) |
[production] |
08:37 |
<hashar> |
tin.eqiad.wmnet: removing live hack in /srv/mediawiki-staging/scap/plugins/clean.py | T187160 |
[production] |
08:32 |
<moritzm> |
installing wavpack security updates |
[production] |
08:09 |
<moritzm> |
installing exim security updates on trusty hosts |
[production] |
07:02 |
<marostegui> |
Deploy schema change on s5 db2089 db2084 db2075 db2039 db2059 - T187089 |
[production] |
06:28 |
<marostegui> |
reload haproxy on dbproxy1005 |
[production] |
05:10 |
<bblack@neodymium> |
conftool action : set/pooled=yes; selector: name=cp50(0[12345789]|1[12]).eqsin.wmnet |
[production] |
02:34 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.20) (duration: 05m 29s) |
[production] |
00:24 |
<cwd> |
re-enabled p-c |
[production] |
00:16 |
<demon@tin> |
Synchronized php-1.31.0-wmf.20/extensions/VisualEditor/modules/ve-mw/ui/pages/: T187112 (duration: 00m 56s) |
[production] |
00:10 |
<cwd> |
disabled p-c jobs for reboot |
[production] |
00:04 |
<demon@tin> |
Synchronized wmf-config/: cleanup Sentry inclusion for labs, should be no-op (duration: 00m 57s) |
[production] |
00:03 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: cleanup Sentry inclusion for labs, should be no-op (duration: 00m 56s) |
[production] |
2018-02-12
§
|
23:47 |
<demon@tin> |
Finished deploy [gerrit/gerrit@6adde70]: reviewers plugin (duration: 00m 12s) |
[production] |
23:46 |
<demon@tin> |
Started deploy [gerrit/gerrit@6adde70]: reviewers plugin |
[production] |
23:32 |
<mutante> |
terbium,wasat: touch /var/log/mediawwiki/purge_abusefilter.log ; set owner/permissions like other logfiles |
[production] |
23:13 |
<elukey> |
manual restart of Yarn Node Managers on analytics1058/31 (failed due to root partition filled up for the issue logged before) |
[production] |
23:09 |
<elukey> |
cleaned up tmp files on all analytics hadoop worker nodes, job filling up tmp |
[production] |
21:27 |
<andrew@tin> |
Finished deploy [horizon/deploy@2f70002]: updating several submodules, probably breaking static content (duration: 03m 18s) |
[production] |
21:24 |
<andrew@tin> |
Started deploy [horizon/deploy@2f70002]: updating several submodules, probably breaking static content |
[production] |
21:06 |
<mholloway-shell@tin> |
Finished deploy [mobileapps/deploy@0639c31]: Update mobileapps to f14bdd5 (duration: 05m 46s) |
[production] |
21:00 |
<mholloway-shell@tin> |
Started deploy [mobileapps/deploy@0639c31]: Update mobileapps to f14bdd5 |
[production] |
20:21 |
<andrew@tin> |
Finished deploy [horizon/deploy@c009388]: updating puppet dashboard (duration: 03m 22s) |
[production] |
20:17 |
<andrew@tin> |
Started deploy [horizon/deploy@c009388]: updating puppet dashboard |
[production] |
20:12 |
<demon@tin> |
Synchronized php-1.31.0-wmf.20/extensions/Flow/includes/Model/UUID.php: T186909 (duration: 00m 56s) |
[production] |
20:08 |
<andrew@tin> |
Finished deploy [horizon/deploy@cba66d2]: more submodule tinkering (duration: 01m 15s) |
[production] |
20:07 |
<ppchelko@tin> |
Finished deploy [restbase/deploy@b257b4f]: Support batching in the reading lists API (duration: 15m 10s) |
[production] |
20:07 |
<andrew@tin> |
Started deploy [horizon/deploy@cba66d2]: more submodule tinkering |
[production] |
20:01 |
<andrew@tin> |
Finished deploy [horizon/deploy@1fcd9ff]: fixes to post-install checks (duration: 01m 02s) |
[production] |
20:00 |
<andrew@tin> |
Started deploy [horizon/deploy@1fcd9ff]: fixes to post-install checks |
[production] |
19:58 |
<andrew@tin> |
Finished deploy [horizon/deploy@9d73005]: fixes to post-isntall checks (duration: 01m 01s) |
[production] |
19:57 |
<andrew@tin> |
Started deploy [horizon/deploy@9d73005]: fixes to post-isntall checks |
[production] |
19:52 |
<ppchelko@tin> |
Started deploy [restbase/deploy@b257b4f]: Support batching in the reading lists API |
[production] |
19:50 |
<andrew@tin> |
Finished deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two (duration: 00m 45s) |
[production] |
19:50 |
<andrew@tin> |
Started deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two |
[production] |
19:48 |
<andrew@tin> |
Finished deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two (duration: 00m 03s) |
[production] |
19:47 |
<andrew@tin> |
Started deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two |
[production] |
19:44 |
<andrew@tin> |
Finished deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes (duration: 01m 06s) |
[production] |
19:43 |
<andrew@tin> |
Started deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes |
[production] |
19:17 |
<niharika29@tin> |
Synchronized wmf-config/filebackend.php: Proxy public wiki thumb.php requests through Thumbor T169144 (duration: 00m 55s) |
[production] |