2018-01-16
ยง
|
18:30 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@1026fd2]: Updating Parsoid to 231bfff (duration: 13m 13s) |
[production] |
18:25 |
<herron> |
removing ganeti VM puppetcompiler1001 |
[production] |
18:19 |
<moritzm> |
rebooting labmon1002 for kernel security update |
[production] |
18:17 |
<arlolra@tin> |
Started deploy [parsoid/deploy@1026fd2]: Updating Parsoid to 231bfff |
[production] |
17:59 |
<moritzm> |
rebooting labnet100[34] and labcontrol100[34] for kernel security update |
[production] |
17:52 |
<herron> |
re-enabled puppet agents |
[production] |
17:50 |
<andrewbogott> |
rebooting labvirt1005 |
[production] |
17:45 |
<herron> |
disabled puppet agents troubleshooting T184444 |
[production] |
17:31 |
<andrewbogott> |
rebooting labvirt1004 |
[production] |
17:11 |
<andrewbogott> |
upgrading and rebooting labvirt1002 |
[production] |
17:06 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore db1092 original weight (duration: 01m 12s) |
[production] |
16:53 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1092 (duration: 01m 12s) |
[production] |
16:40 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1092 (duration: 01m 12s) |
[production] |
16:29 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1092 - T174569 (duration: 01m 08s) |
[production] |
16:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1101:3317 (duration: 01m 12s) |
[production] |
16:11 |
<oblivian@neodymium> |
conftool action : set/pooled=no; selector: cluster=api_appserver,name=mw120[1-8]\.eqiad\.wmnet |
[production] |
16:10 |
<_joe_> |
depooling mw1201-1208 from the API cluster, T185004 |
[production] |
16:09 |
<moritzm> |
rebooting praseodymium for kernel security update |
[production] |
16:08 |
<godog> |
bootstrap cassandra-c on restbase1018 |
[production] |
16:04 |
<chasemp> |
add arturo to acl*operations-team |
[production] |
16:03 |
<moritzm> |
rebooting labweb* hosts for kernel security update |
[production] |
15:57 |
<andrewbogott> |
rebooting labvirt1001 |
[production] |
15:56 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1101:3317 after kernel upgrade (duration: 01m 12s) |
[production] |
15:44 |
<elukey> |
reboot druid1003 for kernel upgrades |
[production] |
15:41 |
<moritzm> |
rebooting achernar for kernel security update |
[production] |
15:38 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1101:3317 after kernel upgrade (duration: 01m 12s) |
[production] |
15:31 |
<moritzm> |
rebooting acamar for kernel security update |
[production] |
15:30 |
<marostegui> |
Deploy schema change on db1101:3318 - T174569 |
[production] |
15:11 |
<marostegui> |
Upgrade mariadb and kernel on db1101 |
[production] |
15:10 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1101:3317 db1101:3318 for schema change, mariadb upgrade and kernel upgrade - T162807 (duration: 01m 12s) |
[production] |
14:59 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 - T162807 (duration: 01m 09s) |
[production] |
14:52 |
<moritzm> |
rebooting graphite1001 for kernel security update |
[production] |
14:35 |
<moritzm> |
rebooting graphite1003 for kernel security update |
[production] |
14:25 |
<moritzm> |
powercycling labtestservices2003, stuck in reboot |
[production] |
14:18 |
<moritzm> |
powercycling labtestservices2001, stuck in reboot |
[production] |
14:13 |
<zeljkof> |
EU SWAT finished |
[production] |
14:12 |
<elukey> |
reboot druid100[56] for kernel upgrades |
[production] |
14:11 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:403571|Revert "Restrict sending mails to new users" config change (T184470)]] (duration: 01m 13s) |
[production] |
14:09 |
<godog> |
bootstrap cassandra-b on restbase1018 |
[production] |
14:01 |
<moritzm> |
rebooting labtest* hosts for kernel security update |
[production] |
13:56 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=druid1004.*.wmnet |
[production] |
13:54 |
<moritzm> |
rebooting graphite1002 for kernel security update |
[production] |
13:52 |
<elukey> |
reboot druid1004 for kernel upgrades |
[production] |
13:46 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=druid1004.*.wmnet |
[production] |
13:46 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=druid1004*.wmnet |
[production] |
13:44 |
<moritzm> |
rebooting graphite2002 for kernel security update |
[production] |
13:31 |
<oblivian@neodymium> |
conftool action : set/weight=25; selector: cluster=api_appserver,name=mw134[3-8[B]\.eqiad\.wmnet |
[production] |
13:28 |
<moritzm> |
rebooting graphite2001 for kernel security update |
[production] |
13:20 |
<oblivian@neodymium> |
conftool action : set/pooled=yes; selector: cluster=api_appserver,name=mw134[3-7]\.eqiad\.wmnet |
[production] |
12:56 |
<elukey> |
reboot kafka100[23] for kernel upgrades |
[production] |