|
2018-05-30
ยง
|
| 13:10 |
<marostegui> |
Deploy schema change on dbstore2001:3315 - T191316 T192926 T89737 T195193 |
[production] |
| 13:00 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2089:3315 after alter table (duration: 01m 02s) |
[production] |
| 12:40 |
<akosiaris> |
reimage ganeti1002, ganeti1005 as stretch |
[production] |
| 12:35 |
<elukey> |
reboot analytics1029,1042,1070 to pick up the new cpu-microcode |
[production] |
| 12:34 |
<gehel> |
starting elasticsearch cluster restart on codfw - T193734 |
[production] |
| 11:04 |
<jynus> |
stop and reimage db1089 |
[production] |
| 10:52 |
<zhuyifei1999_> |
undid both changes to tools-bastion-05 |
[tools] |
| 10:50 |
<zhuyifei1999_> |
also making /proc/sys/kernel/yama/ptrace_scope 0 temporarily on tools-bastion-05 |
[tools] |
| 10:45 |
<zhuyifei1999_> |
installing mono-runtime-dbg on tools-bastion-05 to produce debugging information; was previously installed on tools-exec-1413 & 1441. Might be a good idea to uninstall them once we can close T195834 |
[tools] |
| 10:44 |
<marostegui> |
Deploy schema change on db2089:3315 - T191316 T192926 T89737 T195193 |
[production] |
| 10:43 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2089:3315 for alter table (duration: 01m 01s) |
[production] |
| 10:42 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1089 (duration: 01m 01s) |
[production] |
| 10:35 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2059 after alter table (duration: 01m 02s) |
[production] |
| 09:47 |
<marostegui> |
Deploy schema change on db2059 - T191316 T192926 T89737 T195193 |
[production] |
| 09:33 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2059 for alter table (duration: 01m 02s) |
[production] |
| 09:24 |
<XioNoX> |
peering setup with RIPE RIS in eqsin |
[production] |
| 08:47 |
<elukey> |
reimage druid1004 to Debian Stretch |
[production] |
| 08:38 |
<marostegui> |
Stop and reboot db2094 and db2095 for testing - T190704 |
[production] |
| 08:22 |
<akosiaris> |
upgrade python3-tornado on scb1001 and restart apertium-apy. T194883 |
[production] |
| 07:38 |
<Nikerabbit> |
running refresh-translatable-pages.php for wikis having Translate |
[production] |
| 07:14 |
<moritzm> |
installing git security updates |
[production] |
| 06:56 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool sanitariums masters for s1, s3, s5, s8 - T190704 (duration: 01m 01s) |
[production] |
| 06:43 |
<marostegui> |
Stop db1087 and db2045 in sync - T190704 |
[production] |
| 06:31 |
<marostegui> |
Stop db1082 and db2052 in sync - T190704 |
[production] |
| 06:25 |
<marostegui> |
Stop db1077 and db2043 in sync - T190704 |
[production] |
| 06:17 |
<elukey> |
reimage druid1001 to Debian stretch |
[production] |
| 06:14 |
<elukey> |
re-run failed webrequest-load jobs |
[analytics] |
| 06:11 |
<marostegui> |
Stop db1106 and db2048 in sync - T190704 |
[production] |
| 06:11 |
<elukey> |
temporary point Turnilo to druid1002 to allow druid1001's reimage |
[analytics] |
| 06:10 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool sanitariums masters for s1, s3, s5, s8 - T190704 (duration: 01m 00s) |
[production] |
| 05:59 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool sanitariums masters for s2, s4, s6, s7 - T190704 (duration: 01m 00s) |
[production] |
| 05:50 |
<elukey> |
restart Kafka mirror maker on kafka10[12-23] - failures to consume after rebalance |
[production] |
| 05:50 |
<elukey> |
restart mirror maker on kafka10[12-23] - failures to consume after rebalance |
[analytics] |
| 05:41 |
<marostegui> |
Stop db1079 and db2040 in sync - T190704 |
[production] |
| 05:31 |
<marostegui> |
Stop db1085 and db2039 in sync - T190704 |
[production] |
| 05:23 |
<marostegui> |
Stop db1074 and db2035 in sync - T190704 |
[production] |
| 05:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool sanitariums masters for s2, s4, s6, s7 - T190704 (duration: 01m 03s) |
[production] |
| 05:20 |
<zhuyifei1999_> |
qdel all grid jobs except inc_remindbot & lighttpd-dibot because they are just stuck in an infinite busy loop and consume grid CPU doing nothing T195834 |
[tools.dibot] |
| 05:06 |
<marostegui> |
Deploy schema change on s1 primary master db1052 - T188299 |
[production] |
| 03:15 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed May 30 03:15:44 UTC 2018 (duration 14m 3s) |
[production] |
| 03:01 |
<l10nupdate@tin> |
scap sync-l10n completed (1.32.0-wmf.5) (duration: 12m 57s) |
[production] |
| 01:08 |
<mutante> |
built added rawdog_2.22-1-wmf1 to apt.wikimedia.org, upgraded rawdog on planet2001. Unpacking rawdog (2.22-1-wmf1) over (2.22-1) (T180498) |
[production] |
| 00:45 |
<pnorman@tin> |
Finished deploy [tilerator/deploy@bc35971]: Use parameterized dbname on test2004 (duration: 00m 21s) |
[production] |
| 00:45 |
<pnorman@tin> |
Started deploy [tilerator/deploy@bc35971]: Use parameterized dbname on test2004 |
[production] |
| 00:41 |
<pnorman@tin> |
Finished deploy [tilerator/deploy@a194185]: Deploy test of stretch build of tilerator to test2004 (duration: 00m 12s) |
[production] |
| 00:41 |
<pnorman@tin> |
Started deploy [tilerator/deploy@a194185]: Deploy test of stretch build of tilerator to test2004 |
[production] |
| 00:28 |
<pnorman@tin> |
Finished deploy [tilerator/deploy@a194185]: Deploy test of stretch build of tilerator to test2004 (duration: 00m 05s) |
[production] |
| 00:28 |
<pnorman@tin> |
Started deploy [tilerator/deploy@a194185]: Deploy test of stretch build of tilerator to test2004 |
[production] |
| 00:25 |
<pnorman@tin> |
Finished deploy [tilerator/deploy@a194185]: Deploy test of stretch build of tilerator to test2004 (duration: 02m 17s) |
[production] |
| 00:22 |
<pnorman@tin> |
Started deploy [tilerator/deploy@a194185]: Deploy test of stretch build of tilerator to test2004 |
[production] |