2451-2500 of 10000 results (38ms)
2017-11-07 ยง
16:12 <ema> start cache_text/upload rolling reboots: upgrading kernel to 4.9.51, libssl to 1.0.2m and 1.1.0g [production]
15:46 <gehel> rolling restart of cassandra maps-test for logging change [production]
15:43 <godog> roll-restart thumbor in eqiad for kernel upgrade [production]
15:37 <urandom> T179420: recreating wiktionary definition schemas [production]
15:29 <mobrovac@tin> Finished deploy [restbase/deploy@eab2948]: revert definition switch, wrong schema - T179420 (duration: 06m 46s) [production]
15:22 <mobrovac@tin> Started deploy [restbase/deploy@eab2948]: revert definition switch, wrong schema - T179420 [production]
15:12 <_joe_> added a runner for htmlCacheUpdate on cewiki too [production]
15:10 <mobrovac@tin> Finished deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage - T179420 (duration: 07m 52s) [production]
15:02 <mobrovac@tin> Started deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage - T179420 [production]
14:52 <godog> roll-restart thumbor for kernel upgrades [production]
14:38 <mobrovac> restbase creating wiktionary definition schemas for T179420 [production]
14:36 <godog> reboot wezen for kernel upgrade [production]
14:33 <godog> reboot lithium for kernel upgrade [production]
14:26 <elukey> rolling restart of kafka on kafka-jumbo* for jvm security updates [production]
14:20 <moritzm> rebooting mw canaries to 4.9.51 kernel (also picking up openssl/openssl1.1 updates) [production]
14:19 <moritzm> rearming keyholder on naos [production]
14:14 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Enable ShortUrl on pa.wiki - T178919 (duration: 00m 46s) [production]
14:11 <hashar> mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=pawiki ShortUrl - T178919 [production]
14:08 <moritzm> rebooting tureis for kernel update [production]
14:07 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: add _ in appendix talk namespace at mywiktionary - T179907 (duration: 00m 45s) [production]
14:02 <moritzm> actually holding mw canary reboots until SWAT is over [production]
14:01 <moritzm> rebooting mw canaries to 4.9.51 kernel (also picking up openssl/openssl1.1 updates) [production]
13:50 <herron> rebooted fermium (lists) for kernel update [production]
13:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add comment about db1105 current status (duration: 00m 47s) [production]
13:43 <herron> starting rolling mx reboots for kernel update [production]
13:31 <marostegui> Deploy schema change on s5 codfw master (db2023) with replication, this will generate lag on codfw - T174569 [production]
13:19 <moritzm> rebooting naos for kernel update [production]
13:17 <gehel> reboot maps eqiad cluster for upgrades [production]
13:10 <moritzm> rebooting wasat for kernel update [production]
12:50 <mutante> hafnium, tungsten: groupdel perf-roots to go with gerrit:389663 (T179728) [production]
12:00 <mobrovac@tin> Finished deploy [restbase/deploy@eab2948]: Use the new storage for wikidata.org - T179417 (duration: 08m 14s) [production]
11:52 <mobrovac@tin> Started deploy [restbase/deploy@eab2948]: Use the new storage for wikidata.org - T179417 [production]
11:43 <mobrovac> restbase truncating cassandra 2 non-WP tables for T179417 [production]
11:42 <mobrovac> restbase truncating cassandra 2 non-WP tables for T179420 [production]
11:29 <moritzm> installing java security updates/restarting cassandra on restbase2001 (cassandra3 node) [production]
11:07 <ema> cache_misc rolling reboots: upgrading kernel to 4.9.51, libssl to 1.0.2m and 1.1.0g [production]
10:59 <ema> reboot cp3007: upgrading kernel to 4.9.51, libssl to 1.0.2m and 1.1.0g [production]
10:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Pool db2092 as recentchanges multi-instance host on s1 and s3 T178359 (duration: 00m 45s) [production]
10:58 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Pool db2092 as recentchanges multi-instance host on s1 and s3 T178359 (duration: 00m 45s) [production]
10:41 <moritzm> restarting ntpd on dns recursors to pick up openssl update [production]
10:28 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Pool db2091 as recentchanges multi-instance host on s2 and s4 T178359 (duration: 00m 45s) [production]
10:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Pool db2091 as recentchanges multi-instance host on s2 and s4 T178359 (duration: 00m 46s) [production]
10:24 <elukey> create staging database on db1108 (researchers scratch pad) - T177405 [production]
10:19 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Pool db2086 as recentchanges multi-instance host on s5 and s7 T178359 (duration: 00m 45s) [production]
10:09 <gehel> reboot of maps codfw cluster for upgrades [production]
09:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Pool db2086 as recentchanges multi-instance host on s5 and s7 T178359 (duration: 00m 45s) [production]
09:58 <paravoid> updating certspotter to 0.5 in apt and tegmen/einsteinium [production]
09:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Pool db2089 as recentchanges multi-instance host on s6 and s5(s8) T178359 (duration: 00m 46s) [production]
09:39 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Pool db2089 as recentchanges multi-instance host on s6 and s5(s8) T178359 (duration: 00m 45s) [production]
09:13 <marostegui> Stop MySQL on db1038 - host to be decommissioned - T177911 [production]