|
2018-01-16
ยง
|
| 20:25 |
<demon@tin> |
Started scap: wmf.17 files, no bootstrap of i18n tho |
[production] |
| 20:24 |
<herron> |
temporarily disabling puppet agents while troubleshooting puppet crl |
[production] |
| 20:20 |
<andrewbogott> |
depooling tools-webgrid-lighttpd-1412 and tools-exec-1423 for host reboot |
[tools] |
| 20:19 |
<andrewbogott> |
repooled tools-exec-1409, 1410, 1414, 1419, 1427, 1428 tools-webgrid-generic-1401, tools-webgrid-lighttpd-1406 |
[tools] |
| 20:07 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: group1 to 1.31.0-wmf.16 |
[production] |
| 20:03 |
<andrewbogott> |
rebooting labvirt1009 |
[production] |
| 20:02 |
<madhuvishy> |
reboot shinken-01 |
[shinken] |
| 20:02 |
<andrewbogott> |
depooling tools-exec-1409, 1410, 1414, 1419, 1427, 1428 tools-webgrid-generic-1401, tools-webgrid-lighttpd-1406 |
[tools] |
| 20:00 |
<andrewbogott> |
depooled and repooled tools-webgrid-lighttpd-1427 tools-webgrid-lighttpd-1428 tools-exec-1413 tools-exec-1442 for host reboot |
[tools] |
| 19:46 |
<andrewbogott> |
rebooting labvirt1008 |
[production] |
| 19:46 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.16/includes/Storage/RevisionStore.php: [[gerrit:403930|RevisionStore, fix loadSlotContent with no $blobFlags]] T184749 (duration: 01m 13s) |
[production] |
| 19:30 |
<twentyafterfour> |
restarted wikibugs (several attempts, eventually it worked) |
[production] |
| 18:50 |
<andrewbogott> |
switched active proxy back to tools-proxy-02 |
[tools] |
| 18:50 |
<andrewbogott> |
repooling tools-exec-1422 and tools-webgrid-lighttpd-1413 |
[tools] |
| 18:50 |
<chasemp> |
reboot labvirt1020 |
[production] |
| 18:44 |
<chasemp> |
reboot labvirt1019 |
[production] |
| 18:35 |
<andrewbogott> |
rebooting labvirt1007 |
[production] |
| 18:34 |
<andrewbogott> |
moving proxy from tools-proxy-02 to tools-proxy-01 |
[tools] |
| 18:31 |
<andrewbogott> |
depooling tools-exec-1422 and tools-webgrid-lighttpd-1413 for host reboot |
[tools] |
| 18:30 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@1026fd2]: Updating Parsoid to 231bfff (duration: 13m 13s) |
[production] |
| 18:26 |
<andrewbogott> |
repooling tools-exec-1404 and 1434 for host reboot |
[tools] |
| 18:25 |
<herron> |
removing ganeti VM puppetcompiler1001 |
[production] |
| 18:19 |
<moritzm> |
rebooting labmon1002 for kernel security update |
[production] |
| 18:17 |
<arlolra@tin> |
Started deploy [parsoid/deploy@1026fd2]: Updating Parsoid to 231bfff |
[production] |
| 18:16 |
<greg-g> |
muted shinken in -releng while the reboots are on-going |
[releng] |
| 18:06 |
<andrewbogott> |
depooling tools-exec-1404 and 1434 for host reboot |
[tools] |
| 18:04 |
<andrewbogott> |
repooling tools-exec-1402, 1426, 1429, 1433, tools-webgrid-lighttpd-1408, 1414, 1424 |
[tools] |
| 17:59 |
<moritzm> |
rebooting labnet100[34] and labcontrol100[34] for kernel security update |
[production] |
| 17:52 |
<herron> |
re-enabled puppet agents |
[production] |
| 17:50 |
<andrewbogott> |
rebooting labvirt1005 |
[production] |
| 17:48 |
<andrewbogott> |
depooling tools-exec-1402, 1426, 1429, 1433, tools-webgrid-lighttpd-1408, 1414, 1424 |
[tools] |
| 17:45 |
<herron> |
disabled puppet agents troubleshooting T184444 |
[production] |
| 17:31 |
<andrewbogott> |
rebooting labvirt1004 |
[production] |
| 17:28 |
<andrewbogott> |
disabling tools-webgrid-generic-1402, tools-webgrid-lighttpd-1403, tools-exec-1403 for host reboot |
[tools] |
| 17:26 |
<andrewbogott> |
repooling tools-exec-1405, 1425, tools-webgrid-generic-1403, tools-webgrid-lighttpd-1401, 1405 after host reboot |
[tools] |
| 17:11 |
<andrewbogott> |
upgrading and rebooting labvirt1002 |
[production] |
| 17:08 |
<andrewbogott> |
depooling tools-exec-1405, 1425, tools-webgrid-generic-1403, tools-webgrid-lighttpd-1401, 1405 for host reboot |
[tools] |
| 17:06 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore db1092 original weight (duration: 01m 12s) |
[production] |
| 16:53 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1092 (duration: 01m 12s) |
[production] |
| 16:40 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1092 (duration: 01m 12s) |
[production] |
| 16:29 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1092 - T174569 (duration: 01m 08s) |
[production] |
| 16:19 |
<andrewbogott> |
repooling tools-exec-1401, 1407, 1408, 1430, 1431, 1432, 1435, 1438, 1439, 1441, tools-webgrid-lighttpd-1402, 1407 after host reboot |
[tools] |
| 16:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1101:3317 (duration: 01m 12s) |
[production] |
| 16:11 |
<oblivian@neodymium> |
conftool action : set/pooled=no; selector: cluster=api_appserver,name=mw120[1-8]\.eqiad\.wmnet |
[production] |
| 16:10 |
<_joe_> |
depooling mw1201-1208 from the API cluster, T185004 |
[production] |
| 16:09 |
<moritzm> |
rebooting praseodymium for kernel security update |
[production] |
| 16:08 |
<godog> |
bootstrap cassandra-c on restbase1018 |
[production] |
| 16:04 |
<chasemp> |
add arturo to acl*operations-team |
[production] |
| 16:03 |
<moritzm> |
rebooting labweb* hosts for kernel security update |
[production] |
| 15:57 |
<andrewbogott> |
rebooting labvirt1001 |
[production] |