|
2017-11-07
ยง
|
| 15:46 |
<gehel> |
rolling restart of cassandra maps-test for logging change |
[production] |
| 15:43 |
<godog> |
roll-restart thumbor in eqiad for kernel upgrade |
[production] |
| 15:37 |
<urandom> |
T179420: recreating wiktionary definition schemas |
[production] |
| 15:29 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@eab2948]: revert definition switch, wrong schema - T179420 (duration: 06m 46s) |
[production] |
| 15:22 |
<mobrovac@tin> |
Started deploy [restbase/deploy@eab2948]: revert definition switch, wrong schema - T179420 |
[production] |
| 15:12 |
<_joe_> |
added a runner for htmlCacheUpdate on cewiki too |
[production] |
| 15:10 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage - T179420 (duration: 07m 52s) |
[production] |
| 15:02 |
<mobrovac@tin> |
Started deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage - T179420 |
[production] |
| 14:52 |
<godog> |
roll-restart thumbor for kernel upgrades |
[production] |
| 14:38 |
<mobrovac> |
restbase creating wiktionary definition schemas for T179420 |
[production] |
| 14:36 |
<godog> |
reboot wezen for kernel upgrade |
[production] |
| 14:33 |
<godog> |
reboot lithium for kernel upgrade |
[production] |
| 14:26 |
<elukey> |
rolling restart of kafka on kafka-jumbo* for jvm security updates |
[production] |
| 14:20 |
<moritzm> |
rebooting mw canaries to 4.9.51 kernel (also picking up openssl/openssl1.1 updates) |
[production] |
| 14:19 |
<moritzm> |
rearming keyholder on naos |
[production] |
| 14:14 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable ShortUrl on pa.wiki - T178919 (duration: 00m 46s) |
[production] |
| 14:11 |
<hashar> |
mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=pawiki ShortUrl - T178919 |
[production] |
| 14:08 |
<moritzm> |
rebooting tureis for kernel update |
[production] |
| 14:07 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: add _ in appendix talk namespace at mywiktionary - T179907 (duration: 00m 45s) |
[production] |
| 14:02 |
<moritzm> |
actually holding mw canary reboots until SWAT is over |
[production] |
| 14:01 |
<moritzm> |
rebooting mw canaries to 4.9.51 kernel (also picking up openssl/openssl1.1 updates) |
[production] |
| 13:50 |
<herron> |
rebooted fermium (lists) for kernel update |
[production] |
| 13:46 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add comment about db1105 current status (duration: 00m 47s) |
[production] |
| 13:43 |
<herron> |
starting rolling mx reboots for kernel update |
[production] |
| 13:31 |
<marostegui> |
Deploy schema change on s5 codfw master (db2023) with replication, this will generate lag on codfw - T174569 |
[production] |
| 13:19 |
<moritzm> |
rebooting naos for kernel update |
[production] |
| 13:17 |
<gehel> |
reboot maps eqiad cluster for upgrades |
[production] |
| 13:10 |
<moritzm> |
rebooting wasat for kernel update |
[production] |
| 12:50 |
<mutante> |
hafnium, tungsten: groupdel perf-roots to go with gerrit:389663 (T179728) |
[production] |
| 12:00 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@eab2948]: Use the new storage for wikidata.org - T179417 (duration: 08m 14s) |
[production] |
| 11:52 |
<mobrovac@tin> |
Started deploy [restbase/deploy@eab2948]: Use the new storage for wikidata.org - T179417 |
[production] |
| 11:43 |
<mobrovac> |
restbase truncating cassandra 2 non-WP tables for T179417 |
[production] |
| 11:42 |
<mobrovac> |
restbase truncating cassandra 2 non-WP tables for T179420 |
[production] |
| 11:29 |
<moritzm> |
installing java security updates/restarting cassandra on restbase2001 (cassandra3 node) |
[production] |
| 11:07 |
<ema> |
cache_misc rolling reboots: upgrading kernel to 4.9.51, libssl to 1.0.2m and 1.1.0g |
[production] |
| 10:59 |
<ema> |
reboot cp3007: upgrading kernel to 4.9.51, libssl to 1.0.2m and 1.1.0g |
[production] |
| 10:59 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db2092 as recentchanges multi-instance host on s1 and s3 T178359 (duration: 00m 45s) |
[production] |
| 10:58 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Pool db2092 as recentchanges multi-instance host on s1 and s3 T178359 (duration: 00m 45s) |
[production] |
| 10:41 |
<moritzm> |
restarting ntpd on dns recursors to pick up openssl update |
[production] |
| 10:28 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Pool db2091 as recentchanges multi-instance host on s2 and s4 T178359 (duration: 00m 45s) |
[production] |
| 10:27 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db2091 as recentchanges multi-instance host on s2 and s4 T178359 (duration: 00m 46s) |
[production] |
| 10:24 |
<elukey> |
create staging database on db1108 (researchers scratch pad) - T177405 |
[production] |
| 10:19 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Pool db2086 as recentchanges multi-instance host on s5 and s7 T178359 (duration: 00m 45s) |
[production] |
| 10:09 |
<gehel> |
reboot of maps codfw cluster for upgrades |
[production] |
| 09:59 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db2086 as recentchanges multi-instance host on s5 and s7 T178359 (duration: 00m 45s) |
[production] |
| 09:58 |
<paravoid> |
updating certspotter to 0.5 in apt and tegmen/einsteinium |
[production] |
| 09:40 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db2089 as recentchanges multi-instance host on s6 and s5(s8) T178359 (duration: 00m 46s) |
[production] |
| 09:39 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Pool db2089 as recentchanges multi-instance host on s6 and s5(s8) T178359 (duration: 00m 45s) |
[production] |
| 09:13 |
<marostegui> |
Stop MySQL on db1038 - host to be decommissioned - T177911 |
[production] |
| 09:11 |
<moritzm> |
installing java security updates/restarting cassandra on restbase2002 |
[production] |