|
2019-02-19
§
|
| 07:50 |
<moritzm> |
installing systemd security updates on stretch |
[production] |
| 07:46 |
<marostegui> |
Reboot db1106 for kernel upgrade (and remove debug from kernel) T216240 T216273 |
[production] |
| 07:21 |
<marostegui> |
Drop ep_* tables on s3 - T174802 |
[production] |
| 06:56 |
<marostegui> |
Deploy schema change on db1106 - this will generate lag on labsdb:s1 T210713 |
[production] |
| 06:56 |
<marostegui> |
Deploy schema change on db1106 - T210713 |
[production] |
| 06:56 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1106 T210713 (duration: 00m 52s) |
[production] |
| 05:31 |
<XioNoX> |
delete local pref for peering sessions in ulsfo - T204281 |
[production] |
| 05:17 |
<XioNoX> |
deleted previously deactivated BGP_community_actions terms - T204281 |
[production] |
| 00:01 |
<XioNoX> |
disable BGP to Zayo on cr2-codfw for intrusive testing - T215193 |
[production] |
|
2019-02-18
§
|
| 20:19 |
<gtirloni> |
icinga2001 ran puppet ahead of schedule (enable tools-checker-toolsdb monitor) |
[production] |
| 18:26 |
<jynus> |
setting clouddb1001 in read_write mode |
[production] |
| 18:14 |
<volans> |
upgraded to spicerack 0.0.16-1 cumin[12]001 |
[production] |
| 18:12 |
<volans> |
uploaded spicerack_0.0.16-1_amd64.deb to apt.wikimedia.org stretch-wikimedia |
[production] |
| 18:08 |
<jynus> |
killing mysql on labsdb1005 |
[production] |
| 18:08 |
<jynus> |
disabled puppet and edited my.cnf on labsdb1005 |
[production] |
| 17:56 |
<jynus> |
restarting labsdb1004 |
[production] |
| 17:53 |
<jynus> |
set clouddb1001 in read_only=1 |
[production] |
| 17:49 |
<jijiki> |
Reimaging thumbor1004 to stretch - T214597 |
[production] |
| 17:49 |
<jijiki> |
Reimaging thumbor1004 to stretc - T214597 |
[production] |
| 15:41 |
<jynus> |
performing es2 & es3 backups into es2002 |
[production] |
| 15:21 |
<jynus> |
move logical backups to subdirectory T210292 |
[production] |
| 14:29 |
<moritzm> |
rebooting mw2167 for kernel tests |
[production] |
| 13:59 |
<marostegui> |
Drop ep_* tables from s7 - T174802 |
[production] |
| 13:25 |
<jijiki> |
Depooling thumbor1004 to check if the rest of our hosts can handle the load without it - T214597 |
[production] |
| 12:34 |
<moritzm> |
installing brltty bugfix update from stretch point release |
[production] |
| 12:31 |
<moritzm> |
installing upgrading stat1005 to buster |
[production] |
| 12:28 |
<XioNoX> |
update clouddb_return term from cloud-in4 on cr1/2-eqiad - T216353 |
[production] |
| 11:53 |
<moritzm> |
installing hdparm bugfix update from stretch point release |
[production] |
| 11:36 |
<moritzm> |
installing uriparser security updates |
[production] |
| 11:11 |
<moritzm> |
installing c3p0 security updates |
[production] |
| 10:54 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 T210713 (duration: 00m 46s) |
[production] |
| 10:54 |
<jijiki> |
Reimaging thumbor2002 to stretch - T214597 |
[production] |
| 10:40 |
<marostegui> |
Drop tables ep_* from s2 (cswiki nlwiki ptwiki svwiki) T174802 |
[production] |
| 09:50 |
<marostegui> |
Deploy schema change on db1105:3311 T210713 |
[production] |
| 09:50 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1105:3311 T210713 (duration: 00m 46s) |
[production] |
| 09:46 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 T210713 (duration: 00m 46s) |
[production] |
| 09:28 |
<marostegui> |
Drop ep_* from s6 (ruwiki) - T174802 |
[production] |
| 09:16 |
<marostegui> |
Deploy schema change on db1099:3311 - T210713 |
[production] |
| 09:16 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1099:3311 T210713 (duration: 00m 48s) |
[production] |
| 09:08 |
<marostegui> |
Deploy schema change on dbstore1003:3311 and dbstore1001:3311 - T210713 |
[production] |
| 08:27 |
<marostegui> |
Drop ep_* tables from s5 (srwiki) - T174802 |
[production] |
| 08:23 |
<marostegui> |
Deploy schema change on s1 codfw master (db2048), lag will be generated on s1 codfw - T210713 |
[production] |
| 07:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1119 after mysql upgrade (duration: 00m 46s) |
[production] |
| 06:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: repool db1119 into API service after mysql upgrade (duration: 00m 46s) |
[production] |
| 06:49 |
<marostegui> |
Reboot db2085 to disable debug mode on kernel T216273 |
[production] |
| 06:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1119 after mysql upgrade (duration: 00m 46s) |
[production] |
| 06:29 |
<marostegui> |
Stop MySQL on db1119 for mysql and kernel upgrade |
[production] |
| 06:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1119 for mysql upgrade (duration: 01m 01s) |
[production] |
| 05:55 |
<marostegui> |
Deploy schema change on s8 primary master (db1071) - T210713 |
[production] |
| 05:52 |
<marostegui> |
Set dbstore1002 on read only to start the migration T210478 T215589 |
[production] |