|
2017-11-23
§
|
| 21:15 |
<apergos> |
rebooted mw2251 after unresponsive on mgmt console and no ping |
[production] |
| 20:49 |
<demon@tin> |
Synchronized static/images/project-logos/nowikimedia.png: logo update (duration: 02m 51s) |
[production] |
| 17:29 |
<akosiaris> |
set ganeti1006 as drained. ganeti1005 was already set. That will prevent scheduling VMs on those. T181121 |
[production] |
| 17:01 |
<akosiaris> |
force powercycle on ganeti1006 T181121 |
[production] |
| 16:30 |
<akosiaris> |
gnt-node failover ganeti1006 |
[production] |
| 15:50 |
<jynus> |
disable puppet on db2023, db2038 for deployment whle transfer is ongoing |
[production] |
| 15:23 |
<moritzm> |
rebooting mwdebug* servers for update to 4.9.51 |
[production] |
| 14:10 |
<marostegui> |
Stop Mysql on db1101.s5 to clone db1097 - T178359 |
[production] |
| 14:09 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db1053 in s2 as vslow to replace db1021 - T134476 (duration: 00m 45s) |
[production] |
| 13:13 |
<jynus> |
sutting down db2023 and db2038 for cloning |
[production] |
| 12:47 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: GWToolset migratory config T87928 (duration: 00m 46s) |
[production] |
| 12:40 |
<moritzm> |
migrating instances off ganeti2001 / kernel reboot to 4.9.51 |
[production] |
| 12:10 |
<moritzm> |
migrating instances off ganeti2002 / kernel reboot to 4.9.51 |
[production] |
| 11:52 |
<moritzm> |
migrating instances off ganeti2003 / kernel reboot to 4.9.51 |
[production] |
| 11:37 |
<kartik@tin> |
Finished deploy [cxserver/deploy@51b78ce]: T181209 Update cxserver to e8fe3f0 to fix Youdao MT (duration: 03m 01s) |
[production] |
| 11:35 |
<moritzm> |
migrating instances off ganeti2004 / kernel reboot to 4.9.51 |
[production] |
| 11:35 |
<moritzm> |
migrating instances off ganeti200 / kernel reboot to 4.9.51 |
[production] |
| 11:34 |
<kartik@tin> |
Started deploy [cxserver/deploy@51b78ce]: T181209 Update cxserver to e8fe3f0 to fix Youdao MT |
[production] |
| 11:23 |
<moritzm> |
migrating instances off ganeti2005 / kernel reboot to 4.9.51 |
[production] |
| 11:15 |
<moritzm> |
migrating instances off ganeti2006 / kernel reboot to 4.9.51 |
[production] |
| 11:06 |
<moritzm> |
migrating instances off ganeti2007 / kernel reboot to 4.9.51 |
[production] |
| 10:57 |
<moritzm> |
migrating instances off ganeti2008 / kernel reboot to 4.9.51 |
[production] |
| 10:07 |
<moritzm> |
rebooting sarin for update to 4.9.51 |
[production] |
| 09:16 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: mariadb: Switchover s5 codfw master (duration: 00m 45s) |
[production] |
| 08:56 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1072 (duration: 00m 44s) |
[production] |
| 08:44 |
<jynus> |
stopping and restarting db2052 |
[production] |
| 08:31 |
<moritzm> |
installing bdb security updates on trusty |
[production] |
| 08:29 |
<jynus> |
starting switchover of db2023 to db2052 |
[production] |
| 08:21 |
<marostegui> |
Stop MySQL on db1072 to MySQL upgrade and kernel upgrade |
[production] |
| 08:21 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1072 (duration: 00m 45s) |
[production] |
| 07:28 |
<marostegui> |
Stop MySQL on db1021 and db1053 to clone db1053 |
[production] |
| 07:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1021 - T134476 (duration: 00m 45s) |
[production] |
| 07:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Move db1053 to s2 to replace db1021 as vslow, dump slave - T134476 (duration: 00m 45s) |
[production] |
| 06:58 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1089 - T180045 (duration: 00m 45s) |
[production] |
| 06:55 |
<marostegui> |
Drop index on ores_classification on s1 - T180045 |
[production] |
| 06:53 |
<marostegui> |
Drop index on ores_classification on s2 - T180045 |
[production] |
| 06:53 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1089 - T180045 (duration: 00m 45s) |
[production] |
| 06:44 |
<legoktm> |
legoktm@tin:~$ echo "https://www.mediawiki.org/keys/keys.html" | mwscript purgeList.php |
[production] |
| 06:32 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully pool db1051 and db1063 in vslow service for s5 to warm them up for the s8 split - T177208 (duration: 00m 46s) |
[production] |
| 05:58 |
<kartik@tin> |
Finished deploy [cxserver/deploy@5b35ed5]: Update cxserver to e8fe3f0 (duration: 04m 13s) |
[production] |
| 05:54 |
<kartik@tin> |
Started deploy [cxserver/deploy@5b35ed5]: Update cxserver to e8fe3f0 |
[production] |
| 02:23 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.8) (duration: 05m 27s) |
[production] |
| 01:36 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: dropping education program from cswiki (duration: 00m 45s) |
[production] |
| 01:29 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: Set $wgCentralAuthGlobalBlockInterwikiPrefix (duration: 00m 45s) |
[production] |
| 01:26 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: no-op (duration: 00m 44s) |
[production] |
| 01:24 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: abusefilter stuff (duration: 00m 45s) |
[production] |
| 01:21 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: abusefilter stuff (duration: 00m 45s) |
[production] |
| 01:19 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: abusefilter stuff (duration: 00m 45s) |
[production] |
| 01:05 |
<demon@tin> |
Synchronized docroot/mediawiki/keys/: update formatting, docs, etc (duration: 00m 46s) |
[production] |