|
2018-01-16
ยง
|
| 22:49 |
<chasemp> |
restarted everything I could find in the stack :) |
[codesearch] |
| 22:40 |
<mobrovac@tin> |
Synchronized wmf-config/InitialiseSettings.php: Use EventBus for htmlCacheUpdate jobs for all wikis but en, commons and wikidata - T182023 (duration: 01m 12s) |
[production] |
| 22:39 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@19b9bdd]: Switch htmlCacheUpdates for all but en, commons, wikidata T182023 (duration: 00m 35s) |
[production] |
| 22:39 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@19b9bdd]: Switch htmlCacheUpdates for all but en, commons, wikidata T182023 |
[production] |
| 22:33 |
<halfak> |
creating ores-worker-01/02/03/04 as stretch instances. |
[ores] |
| 22:27 |
<halfak> |
deleting ores-worker-05/06/07 |
[ores] |
| 22:25 |
<halfak> |
shutting down ores-worker-05/06/07 |
[ores] |
| 22:23 |
<halfak> |
deleting ores-web-03/05 |
[ores] |
| 22:19 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.17/extensions/WikimediaMessages/WikimediaMessages.hooks.php: [[gerrit:404583|Update access to ORES isModelEnabled()]] (duration: 01m 13s) |
[production] |
| 22:19 |
<ottomata> |
apt-get install librdkafka1=0.9.4-1~jessie1 librdkafka++1=0.9.4-1~jessie1 on scb* to put librdkafka back at node-rdkafka compat version (somehow this was upgraded yesterday...very dangerous!!) |
[production] |
| 22:16 |
<thcipriani@tin> |
Finished scap: testwiki to php-1.31.0-wmf.17 and rebuild l10n cache (duration: 25m 45s) |
[production] |
| 22:15 |
<halfak> |
pooling ores-web-01/02 |
[ores] |
| 22:06 |
<halfak> |
created ores-web-02 as a debian stretch instance. |
[ores] |
| 22:01 |
<halfak> |
deleted ores-redis-01 (seemingly unused) |
[ores] |
| 22:01 |
<chasemp> |
qstat -explain E -xml | grep 'name' | sed 's/<name>//' | sed 's/<\/name>//' | xargs qmod -cq |
[tools] |
| 21:54 |
<chasemp> |
tools-exec-1436:~$ /sbin/reboot |
[tools] |
| 21:54 |
<rxy> |
"@cvn-app9:/srv/cvn/services/cvnbot/CVNBot16$ sudo chmod g+w Projects.xml" : error fixing when execute command "batchreload" |
[cvn] |
| 21:50 |
<thcipriani@tin> |
Started scap: testwiki to php-1.31.0-wmf.17 and rebuild l10n cache |
[production] |
| 21:29 |
<thcipriani> |
armed keyholder using instructions on https://wikitech.wikimedia.org/wiki/Keyholder |
[releng] |
| 21:24 |
<andrewbogott> |
repooled tools-exec-1420 and tools-webgrid-lighttpd-1417 |
[tools] |
| 21:15 |
<andrewbogott> |
rebooting labvirt1014 and 1015 |
[production] |
| 21:14 |
<andrewbogott> |
depooling tools-exec-1420 and tools-webgrid-lighttpd-1417 |
[tools] |
| 21:04 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: all wikis to 1.31.0-wmf.16 |
[production] |
| 20:59 |
<andrewbogott> |
rebooting labvirt1013 |
[production] |
| 20:58 |
<andrewbogott> |
depooling tools-exec-1412, 1415, 1417, tools-webgrid-lighttpd-1415, 1416, 1422, 1426 |
[tools] |
| 20:56 |
<andrewbogott> |
repooling tools-exec-1416, 1418, 1424, tools-webgrid-lighttpd-1404, tools-webgrid-lighttpd-1410 |
[tools] |
| 20:46 |
<andrewbogott> |
depooling tools-exec-1416, 1418, 1424, tools-webgrid-lighttpd-1404, tools-webgrid-lighttpd-1410 |
[tools] |
| 20:46 |
<andrewbogott> |
repooled tools-exec-1406, 1421, 1436, 1437, tools-webgrid-generic-1404, tools-webgrid-lighttpd-1409, tools-webgrid-lighttpd-1411, tools-webgrid-lighttpd-1418, tools-webgrid-lighttpd-1425 |
[tools] |
| 20:42 |
<demon@tin> |
Finished scap: wmf.17 files, no bootstrap of i18n tho (x2) (duration: 06m 33s) |
[production] |
| 20:35 |
<demon@tin> |
Started scap: wmf.17 files, no bootstrap of i18n tho (x2) |
[production] |
| 20:34 |
<demon@tin> |
scap aborted: wmf.17 files, no bootstrap of i18n tho (duration: 08m 59s) |
[production] |
| 20:34 |
<andrewbogott> |
rebooting labvirt1011 |
[production] |
| 20:33 |
<andrewbogott> |
depooling tools-exec-1406, 1421, 1436, 1437, tools-webgrid-generic-1404, tools-webgrid-lighttpd-1409, tools-webgrid-lighttpd-1411, tools-webgrid-lighttpd-1418, tools-webgrid-lighttpd-1425 |
[tools] |
| 20:32 |
<herron> |
re-enabling puppet agents |
[production] |
| 20:25 |
<demon@tin> |
Started scap: wmf.17 files, no bootstrap of i18n tho |
[production] |
| 20:24 |
<herron> |
temporarily disabling puppet agents while troubleshooting puppet crl |
[production] |
| 20:20 |
<andrewbogott> |
depooling tools-webgrid-lighttpd-1412 and tools-exec-1423 for host reboot |
[tools] |
| 20:19 |
<andrewbogott> |
repooled tools-exec-1409, 1410, 1414, 1419, 1427, 1428 tools-webgrid-generic-1401, tools-webgrid-lighttpd-1406 |
[tools] |
| 20:07 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: group1 to 1.31.0-wmf.16 |
[production] |
| 20:03 |
<andrewbogott> |
rebooting labvirt1009 |
[production] |
| 20:02 |
<madhuvishy> |
reboot shinken-01 |
[shinken] |
| 20:02 |
<andrewbogott> |
depooling tools-exec-1409, 1410, 1414, 1419, 1427, 1428 tools-webgrid-generic-1401, tools-webgrid-lighttpd-1406 |
[tools] |
| 20:00 |
<andrewbogott> |
depooled and repooled tools-webgrid-lighttpd-1427 tools-webgrid-lighttpd-1428 tools-exec-1413 tools-exec-1442 for host reboot |
[tools] |
| 19:46 |
<andrewbogott> |
rebooting labvirt1008 |
[production] |
| 19:46 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.16/includes/Storage/RevisionStore.php: [[gerrit:403930|RevisionStore, fix loadSlotContent with no $blobFlags]] T184749 (duration: 01m 13s) |
[production] |
| 19:30 |
<twentyafterfour> |
restarted wikibugs (several attempts, eventually it worked) |
[production] |
| 18:50 |
<andrewbogott> |
switched active proxy back to tools-proxy-02 |
[tools] |
| 18:50 |
<andrewbogott> |
repooling tools-exec-1422 and tools-webgrid-lighttpd-1413 |
[tools] |
| 18:50 |
<chasemp> |
reboot labvirt1020 |
[production] |
| 18:44 |
<chasemp> |
reboot labvirt1019 |
[production] |