2018-12-12
ยง
|
15:20 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1098:3316 db1098:3317 after kernel and mysql upgrade (duration: 00m 53s) |
[production] |
14:43 |
<banyek> |
renaming tables on db1122 ptwiki: flagged* -> T211544_flagged* - T211544 |
[production] |
14:29 |
<zfilipin@deploy1001> |
rebuilt and synchronized wikiversions files: Revert "group1 wikis to 1.33.0-wmf.8" |
[production] |
14:18 |
<moritzm> |
restart uwsgi-netbox on netmon2001 |
[production] |
14:16 |
<zfilipin@deploy1001> |
Synchronized php: group1 wikis to 1.33.0-wmf.8 (duration: 00m 51s) |
[production] |
14:14 |
<zfilipin@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.8 |
[production] |
14:07 |
<mobrovac@deploy1001> |
Started restart [restbase/deploy@5946231]: Restart RB to pick up the new seeds in codfw - T211416 |
[production] |
14:04 |
<marostegui> |
Stopy MySQL on db1098:3316 and db1098:3317 for kernel and mysql upgrade |
[production] |
13:28 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 db1098:3317 for kernel and mysql upgrade (duration: 00m 52s) |
[production] |
13:26 |
<moritzm> |
installing PHP security updates |
[production] |
12:52 |
<zeljkof> |
EU SWAT finished |
[production] |
12:49 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:477979|Add NS_PROJECT localised name for tt.wiktionary (T211312)]] (duration: 00m 52s) |
[production] |
12:41 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471345|Add new namespace aliases for zhwikiversity (T207544)]] (duration: 00m 52s) |
[production] |
12:35 |
<arturo> |
T205969 icinga downtime load-avg check for labstore1007 until January (1 month) |
[production] |
12:32 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478896|Enable extension SandboxLink for nowiki (T210325)]] (duration: 00m 52s) |
[production] |
12:27 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478891|Use HD logos for cawikimedia in IS.php (T198507)]] (duration: 00m 52s) |
[production] |
12:17 |
<zfilipin@deploy1001> |
Synchronized static/images/project-logos/: SWAT: [[gerrit:478890|Upload new logos for cawikimedia (T198507)]] (duration: 00m 52s) |
[production] |
12:03 |
<hoo@deploy1001> |
Synchronized wmf-config/Wikibase.php: Display Kartographer mapframes for geocoordinate statements (T184933) (duration: 00m 52s) |
[production] |
11:30 |
<volans> |
re-enabled puppet on icinga[12]001, re-activated crontab to sync files on 2001 and manually run it + run puppet |
[production] |
11:14 |
<volans> |
restarting icinga with dropped downtimes from last night (start_date > 1544489652) |
[production] |
11:03 |
<volans> |
restarting Icinga with debug log on icinga1001 |
[production] |
10:51 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2b - T211416 (duration: 10m 11s) |
[production] |
10:41 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2b - T211416 |
[production] |
10:40 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2 - T211416 (duration: 00m 15s) |
[production] |
10:40 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2 - T211416 |
[production] |
10:26 |
<volans> |
Icinga is having issue restarting properly, investigation ongoing |
[production] |
10:08 |
<banyek> |
executing schema change on db1070 (s5 master) - T85757 |
[production] |
09:40 |
<banyek> |
repooling labsdb1010 - T210693 |
[production] |
09:34 |
<banyek@deploy1001> |
Synchronized wmf-config/db-eqiad.php: T85757: repool db1082 (duration: 00m 52s) |
[production] |
09:29 |
<banyek> |
repooling db1082 - T85757 |
[production] |
09:25 |
<banyek> |
restarting replication on db1082 after schema change - T85757 |
[production] |
09:25 |
<banyek> |
fixing triggers on db1124:3315- T85757 |
[production] |
09:22 |
<banyek> |
executing schema change with replication on db1082 - T85757 |
[production] |
09:20 |
<banyek> |
stopping replication on db1082 for schema change - T85757 |
[production] |
09:15 |
<moritzm> |
installing pixman security updates on trusty (Debian already fixed) |
[production] |
08:48 |
<banyek@deploy1001> |
Synchronized wmf-config/db-eqiad.php: T85757: depool db1082 (duration: 00m 51s) |
[production] |
08:38 |
<banyek> |
depooling db1082 for schema change - T85757 |
[production] |
08:37 |
<marostegui> |
Remove old backup directory from db1116 - T206743 |
[production] |
08:18 |
<godog> |
decommissioning cassandra-b, restbase2006 -- T210843 |
[production] |
08:03 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1088 (duration: 00m 51s) |
[production] |
07:49 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 52s) |
[production] |
07:38 |
<marostegui> |
Deploy schema change on db2040 (s7 codfw master), this will generate lag on codfw T86338 T202167 |
[production] |
07:35 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 51s) |
[production] |
07:09 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 51s) |
[production] |
06:55 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 52s) |
[production] |
06:44 |
<marostegui> |
Stop MySQL on db1088 for mysql and kernel upgrade |
[production] |
06:44 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1088 for mysql upgrade (duration: 01m 07s) |
[production] |
06:37 |
<marostegui> |
Deploy schema change on s4 primary master (db1068) T86338 |
[production] |
06:00 |
<marostegui> |
Deploy schema change on s8 primary master (db1071) T86338 T202167 |
[production] |
00:47 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478467|Add some missing groups to the privileged list]] (duration: 00m 51s) |
[production] |