|
2018-08-14
§
|
| 15:01 |
<moritzm> |
rebooting meitnerium/archiva.wikimedia.org for kernel security update |
[production] |
| 14:59 |
<ema> |
cache_text eqiad: restart varnish-be without transient storage caps |
[production] |
| 14:53 |
<moritzm> |
rebooting cloudelastic* for kernel update |
[production] |
| 14:50 |
<gehel> |
reimage of elastic103[678] |
[production] |
| 14:41 |
<bstorm@deploy1001> |
Finished deploy [striker/deploy@13da520]: (no justification provided) (duration: 01m 13s) |
[production] |
| 14:40 |
<bstorm@deploy1001> |
Started deploy [striker/deploy@13da520]: (no justification provided) |
[production] |
| 14:35 |
<Krinkle> |
Copying xenon/logs/daily/2018-*{all,load,index,api,RunSingleJob}.log from mwlog1001 to webperfX002 hosts |
[production] |
| 14:26 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1102 with full weight (duration: 00m 52s) |
[production] |
| 14:21 |
<ema@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp1089.eqiad.wmnet,service=varnish-be |
[production] |
| 14:05 |
<ema> |
restart varnish-be on cp108[79], fetch failures after child crashes |
[production] |
| 13:47 |
<gehel> |
restarting elasticsearch on elastic1051 (overloaded) |
[production] |
| 13:21 |
<gehel> |
restarting elasticsearch on elastic1043 (overloaded) |
[production] |
| 13:11 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1308-mw1311/mw1293-mw1296 (HHVM bytecode cache is pruned during update) |
[production] |
| 12:57 |
<gehel> |
restarting tilerator on maps eqiad |
[production] |
| 12:54 |
<Trey314159> |
reindexing Indonesian wikis on elastic@eqiad and elastic@codfw complete (T200204) |
[production] |
| 12:49 |
<moritzm> |
upgrading wikidiff to 1.7.2 on snapshot hosts |
[production] |
| 11:58 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1276-mw1283 (HHVM bytecode cache is pruned during update) |
[production] |
| 11:40 |
<TimStarling> |
restarted populateContentTables.php on s2 (T183488) |
[production] |
| 11:20 |
<zeljkof> |
EU SWAT finished |
[production] |
| 11:19 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1299-mw1306 (HHVM bytecode cache is pruned during update) |
[production] |
| 11:19 |
<zfilipin@deploy1001> |
Synchronized vendor/perftools/xhgui-collector/external/header.php: SWAT: [[gerrit:452051|Fix "the the" typo in vendor/perftools/xhgui-collector/external/header.php (T201491)]] (duration: 00m 49s) |
[production] |
| 11:17 |
<zfilipin@deploy1001> |
Synchronized wmf-config/CirrusSearch-common.php: SWAT: [[gerrit:452050|Fix the the typo in wmf-config/CirrusSearch-common.php (T201491)]] (duration: 00m 51s) |
[production] |
| 11:14 |
<moritzm> |
repooled mw1233 (debugging completed) |
[production] |
| 10:45 |
<moritzm> |
repooled mw1227 (was probably overlooked to repool after previous debugging) |
[production] |
| 10:41 |
<volans> |
upgraded cumin on labpuppetmaster* to fix cumin with the new openstack region - T201881 |
[production] |
| 10:16 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1221-mw1235 (HHVM bytecode cache is pruned during update) |
[production] |
| 10:12 |
<volans> |
uploaded cumin_3.0.2-2_amd64.deb to apt.wikimedia.org jessie-wikimedia |
[production] |
| 09:50 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1102 with low load (duration: 00m 50s) |
[production] |
| 09:32 |
<jynus> |
stop and restart db1122 for maintenance |
[production] |
| 09:27 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1102 (duration: 00m 52s) |
[production] |
| 09:23 |
<addshore> |
for i in {10000..12500}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki --skip-exists-check # T198301 |
[production] |
| 09:20 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1238-mw1258 (HHVM bytecode cache is pruned during update) |
[production] |
| 09:17 |
<addshore> |
for i in {6000..10000}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki --skip-exists-check # T198301 |
[production] |
| 09:13 |
<addshore> |
for i in {3000..6000}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki --skip-exists-check # T198301 |
[production] |
| 09:08 |
<addshore> |
for i in {1000..3000}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki --skip-exists-check # T198301 |
[production] |
| 09:07 |
<addshore> |
for i in {1..1000}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki --skip-exists-check # T198301 |
[production] |
| 08:51 |
<addshore> |
addshore@labweb1001:~$ mwscript extensions/OATHAuth/maintenance/disableOATHAuthForUser.php --wiki=labswiki GoranSMilovanovic # T201122 |
[production] |
| 08:19 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1266-mw1275 (HHVM bytecode cache is pruned during update) |
[production] |
| 07:56 |
<moritzm> |
installing ghostscript security updates |
[production] |
| 07:05 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1101:s7 and db1101:s8 (duration: 00m 52s) |
[production] |
| 06:45 |
<_joe_> |
rolling restart of hhvm in eqiad api, high load |
[production] |
| 06:37 |
<_joe_> |
depooling mw1233 from live traffic for debugging |
[production] |
| 05:13 |
<TimStarling> |
killed populateContentTables.php for s2 at jcrespo's request |
[production] |
| 02:45 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Tue Aug 14 02:45:46 UTC 2018 (duration 10m 25s) |
[production] |
| 02:35 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.16) (duration: 13m 57s) |
[production] |
| 00:35 |
<aaron@deploy1001> |
Synchronized wmf-config/mc.php: Enable broadcasted mcrouter cache operations for test wikis and mw.org (duration: 00m 49s) |
[production] |
| 00:15 |
<mutante> |
graphite2002 - stopping carbon-local-relay, running puppet to start it again to confirm no issues with gerrit:448779 |
[production] |
| 00:09 |
<aaron@deploy1001> |
Synchronized wmf-config/mc.php: Only do cache writes to mcrouter for all wikis (duration: 00m 52s) |
[production] |