6551-6600 of 10000 results (53ms)
2018-01-10 ยง
16:03 <marostegui> Deploy schema change on db1095.s5 - https://phabricator.wikimedia.org/T174569 [production]
16:02 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 - T174569 (duration: 01m 02s) [production]
15:59 <godog> start cassandra-a on restbase1011 [production]
15:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1097:3315 - T174569 (duration: 01m 03s) [production]
15:32 <moritzm> rebooting yubico auth servers for kernel security update [production]
15:14 <moritzm> reboot netmon1002 / netmon2001 for kernel security update [production]
14:54 <ema> codfw LVSs: upgrade to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 [production]
14:51 <godog> start cassandra-a on restbase1011 - T184100 [production]
14:50 <zeljkof> EU SWAT finished [production]
14:50 <jynus> dropping dewiki from dbstore2001:3318 T184599 [production]
14:47 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:402780|translationadmin: remove configuration equal to CommonSettings.php (T184314)]] (duration: 01m 02s) [production]
14:46 <zfilipin@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:403410|translationadmin: typo fix]] (duration: 01m 03s) [production]
14:42 <chasemp> new meltdown images are live in cloud land [production]
14:34 <jynus> dropping wikidatawiki from dbstore2001:3315 T184599 [production]
14:09 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:403342|Lift the cap on IP address to create accounts on mrwiki (T184579)]] (duration: 01m 04s) [production]
14:05 <moritzm> migrating instances off ganeti2002 for subsequent reboot for kernel security update [production]
13:37 <moritzm> migrating instances off ganeti2003 for subsequent reboot for kernel security update [production]
13:26 <_joe_> restarting pybal on lvs2003 [production]
13:03 <mobrovac@tin> Finished deploy [restbase/deploy@a2aabfb]: API: add top-by-country, change recommendation route, fix duplicates in onthisday - T181520 T170877 T175974 (duration: 08m 00s) [production]
12:55 <mobrovac@tin> Started deploy [restbase/deploy@a2aabfb]: API: add top-by-country, change recommendation route, fix duplicates in onthisday - T181520 T170877 T175974 [production]
12:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1097:3315 - T174569 (duration: 01m 03s) [production]
12:54 <marostegui> Deploy schema change on db1097:3315 - https://phabricator.wikimedia.org/T174569 [production]
12:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1106 - T174569 (duration: 01m 03s) [production]
12:38 <moritzm> migrating instances off ganeti2004 for subsequent reboot for kernel security update [production]
12:19 <moritzm> migrating instances off ganeti2005 for subsequent reboot for kernel security update [production]
12:11 <moritzm> rebooting einsteinium for kernel security update [production]
11:51 <moritzm> migrating instances off ganeti2006 for subsequent reboot for kernel security update [production]
11:45 <godog> downtime decomissioned restbase cassandra 2 hosts [production]
11:39 <moritzm> rebooting mw1201-mw1208 for kernel security update (along with update to HHVM 3.18.6) [production]
11:33 <marostegui> Deploy schema change on db1106 - T174569 [production]
11:26 <elukey> reboot analytics1044->47 for kernel updates [production]
11:23 <moritzm> migrating instances off ganeti2007 for subsequent reboot for kernel security update [production]
11:19 <volans> Icinga failover to tegmen completed - T170353 [production]
11:12 <moritzm> migrating instances off ganeti2008 for subsequent reboot for kernel security update [production]
11:07 <volans> start failovering of Icinga to tegmen - T170353 [production]
10:55 <elukey> reboot analytics1040->43 for kernel updates [production]
10:29 <godog> reimage restbase1011 to test HBA mode - T184100 [production]
10:16 <moritzm> rebooting bast4001 for kernel security update [production]
10:06 <elukey> rebooting analytics1035 (hadoop worker node and hdfs journal node) for kernel updates [production]
10:02 <moritzm> rebooting tegmen for kernel security update [production]
09:50 <godog> shut cassandra 2 on restbase legacy nodes - T184100 [production]
09:40 <moritzm> rebooting kubernetes workers (plus staging hosts) for kernel security update [production]
09:39 <ema> eqiad LVSs: upgrade to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 [production]
09:32 <marostegui> Upgrade kernel on db1067 [production]
09:27 <godog> stop restbase on cassandra 2 nodes - T184100 [production]
09:15 <marostegui> Deploy schema change on db1051 - T174569 [production]
09:12 <moritzm> rebooting radium (tor relay) for kernel security update [production]
08:42 <marostegui> Stop replication in sync on db1089 and db1067 - T162807 [production]
08:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1067 and db1089 - T162807 (duration: 01m 05s) [production]
08:38 <marostegui> Deploy schema change on s5 dbstore1001 - T174569 [production]