4651-4700 of 10000 results (41ms)
2018-01-10 ยง
16:35 <godog> bounce thumbor-instances on thumbor1001 [production]
16:26 <anomie> Running cleanupUsersWithNoId.php on dewiki and wikidatawiki [production]
16:22 <ottomata> restarting kafka jumbo brokers to apply java.security certpath restrictions [production]
16:08 <godog> roll-restart swift frontend in eqiad for kernel upgrade [production]
16:06 <moritzm> migrating instances off ganeti2001 for subsequent reboot for kernel security update [production]
16:05 <moritzm> switched ganeti master node in codfw to ganeti2004 [production]
16:03 <marostegui> Deploy schema change on db1095.s5 - https://phabricator.wikimedia.org/T174569 [production]
16:02 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 - T174569 (duration: 01m 02s) [production]
15:59 <godog> start cassandra-a on restbase1011 [production]
15:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1097:3315 - T174569 (duration: 01m 03s) [production]
15:32 <moritzm> rebooting yubico auth servers for kernel security update [production]
15:14 <moritzm> reboot netmon1002 / netmon2001 for kernel security update [production]
14:54 <ema> codfw LVSs: upgrade to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 [production]
14:51 <godog> start cassandra-a on restbase1011 - T184100 [production]
14:50 <zeljkof> EU SWAT finished [production]
14:50 <jynus> dropping dewiki from dbstore2001:3318 T184599 [production]
14:47 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:402780|translationadmin: remove configuration equal to CommonSettings.php (T184314)]] (duration: 01m 02s) [production]
14:46 <zfilipin@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:403410|translationadmin: typo fix]] (duration: 01m 03s) [production]
14:42 <chasemp> new meltdown images are live in cloud land [production]
14:34 <jynus> dropping wikidatawiki from dbstore2001:3315 T184599 [production]
14:09 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:403342|Lift the cap on IP address to create accounts on mrwiki (T184579)]] (duration: 01m 04s) [production]
14:05 <moritzm> migrating instances off ganeti2002 for subsequent reboot for kernel security update [production]
13:37 <moritzm> migrating instances off ganeti2003 for subsequent reboot for kernel security update [production]
13:26 <_joe_> restarting pybal on lvs2003 [production]
13:03 <mobrovac@tin> Finished deploy [restbase/deploy@a2aabfb]: API: add top-by-country, change recommendation route, fix duplicates in onthisday - T181520 T170877 T175974 (duration: 08m 00s) [production]
12:55 <mobrovac@tin> Started deploy [restbase/deploy@a2aabfb]: API: add top-by-country, change recommendation route, fix duplicates in onthisday - T181520 T170877 T175974 [production]
12:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1097:3315 - T174569 (duration: 01m 03s) [production]
12:54 <marostegui> Deploy schema change on db1097:3315 - https://phabricator.wikimedia.org/T174569 [production]
12:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1106 - T174569 (duration: 01m 03s) [production]
12:38 <moritzm> migrating instances off ganeti2004 for subsequent reboot for kernel security update [production]
12:19 <moritzm> migrating instances off ganeti2005 for subsequent reboot for kernel security update [production]
12:11 <moritzm> rebooting einsteinium for kernel security update [production]
11:51 <moritzm> migrating instances off ganeti2006 for subsequent reboot for kernel security update [production]
11:45 <godog> downtime decomissioned restbase cassandra 2 hosts [production]
11:39 <moritzm> rebooting mw1201-mw1208 for kernel security update (along with update to HHVM 3.18.6) [production]
11:33 <marostegui> Deploy schema change on db1106 - T174569 [production]
11:26 <elukey> reboot analytics1044->47 for kernel updates [production]
11:23 <moritzm> migrating instances off ganeti2007 for subsequent reboot for kernel security update [production]
11:19 <volans> Icinga failover to tegmen completed - T170353 [production]
11:12 <moritzm> migrating instances off ganeti2008 for subsequent reboot for kernel security update [production]
11:07 <volans> start failovering of Icinga to tegmen - T170353 [production]
10:55 <elukey> reboot analytics1040->43 for kernel updates [production]
10:29 <godog> reimage restbase1011 to test HBA mode - T184100 [production]
10:16 <moritzm> rebooting bast4001 for kernel security update [production]
10:06 <elukey> rebooting analytics1035 (hadoop worker node and hdfs journal node) for kernel updates [production]
10:02 <moritzm> rebooting tegmen for kernel security update [production]
09:50 <godog> shut cassandra 2 on restbase legacy nodes - T184100 [production]
09:40 <moritzm> rebooting kubernetes workers (plus staging hosts) for kernel security update [production]
09:39 <ema> eqiad LVSs: upgrade to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 [production]
09:32 <marostegui> Upgrade kernel on db1067 [production]