|
2018-06-11
§
|
| 06:39 |
<elukey> |
restart pdfrender on scb1002 |
[production] |
| 06:14 |
<marostegui> |
Deploy schema change on s4 codfw master (db2051) this will generate lag on codfw - T191316 T192926 T89737 T195193 |
[production] |
| 06:10 |
<marostegui> |
Stop replication on db2095 to update triggers - T192926 |
[production] |
| 05:32 |
<marostegui> |
Restart mysql on codfw sanitariums (db1095, db1102, db1124, db1125) to pick up new replication filters - T196748 |
[production] |
| 05:28 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Repool pc2005 - T196339 (duration: 00m 52s) |
[production] |
| 05:25 |
<marostegui> |
Restart mysql on codfw sanitariums (db2094, db2095) to pick up new replication filters - T196748 |
[production] |
| 05:17 |
<marostegui> |
Stop MySQL and reboot pc2005 for intel-microcode update and final HW check - T196339 |
[production] |
| 05:15 |
<marostegui> |
Deploy schema change on s6 primary master (db1061) - T191316 T192926 T195193 |
[production] |
| 02:42 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Mon Jun 11 02:42:42 UTC 2018 (duration 10m 16s) |
[production] |
| 02:32 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.7) (duration: 13m 06s) |
[production] |
|
2018-06-08
§
|
| 22:41 |
<no_justification> |
gerrit: restarting |
[production] |
| 19:36 |
<urandom> |
upgrade Cassandra to 3.11.2, restbase1015 & restbase1018 - T178905 |
[production] |
| 18:49 |
<urandom> |
upgrade Cassandra to 3.11.2, restbase1009 & restbase1014 - T178905 |
[production] |
| 18:02 |
<urandom> |
upgrade Cassandra to 3.11.2, restbase1017 & restbase1013 - T178905 |
[production] |
| 17:33 |
<no_justification> |
gerrit: up mostly, but will see some errors about "wip" label for a bit until reindexing completes. |
[production] |
| 17:28 |
<cmjohnson> |
powering flerovium down to move to a different space in the rack |
[production] |
| 17:14 |
<demon@deploy1001> |
Finished deploy [gerrit/gerrit@7324140]: 2.15.2 (duration: 00m 11s) |
[production] |
| 17:14 |
<demon@deploy1001> |
Started deploy [gerrit/gerrit@7324140]: 2.15.2 |
[production] |
| 17:12 |
<no_justification> |
gerrit: taking offline for 2.14 -> 2.15 upgrade |
[production] |
| 15:35 |
<urandom> |
upgrade Cassandra to 3.11.2, restbase1012 - T178905 |
[production] |
| 15:26 |
<marostegui> |
Restart MySQL on codfw sanitarium hosts db2094, db2095 - https://phabricator.wikimedia.org/T196748 |
[production] |
| 15:00 |
<urandom> |
upgrade Cassandra to 3.11.2, restbase1008 - T178905 |
[production] |
| 14:17 |
<urandom> |
upgrade Cassandra to 3.11.2, restbase1011 & restbase1016 - T178905 |
[production] |
| 12:14 |
<twentyafterfour> |
running phabricator public_task_dump script manually to confirm that it's working as expected. |
[production] |
| 09:31 |
<arturo> |
merging https://gerrit.wikimedia.org/r/#/c/436337/ for the eqia1 openstack deployment (labcontrol1003/labcontrol1004) |
[production] |
| 09:19 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Unify and update sanitarium comments - T190704 (duration: 00m 50s) |
[production] |
| 09:18 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Unify and update sanitarium comments - T190704 (duration: 00m 50s) |
[production] |
| 09:06 |
<akosiaris@deploy1001> |
Started deploy [proton/deploy@97ec4bf]: (no justification provided) |
[production] |
| 08:35 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1066 after reboot (duration: 00m 50s) |
[production] |
| 08:18 |
<marostegui> |
Stop MySQL and reboot db1066 for intel-microcode install - T194870 |
[production] |
| 08:18 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1066 for reboot (duration: 00m 50s) |
[production] |
| 07:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 after alter table (duration: 00m 51s) |
[production] |
| 07:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Restore db1091 original weight (duration: 00m 50s) |
[production] |
| 07:25 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1091 (duration: 00m 50s) |
[production] |
| 07:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increse weight for db1091 (duration: 00m 50s) |
[production] |
| 06:47 |
<gilles@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T196630 Remove unneeded description from performance survey definition (duration: 00m 52s) |
[production] |
| 06:44 |
<elukey> |
bounce kafka mirror maker main-eqiad-to-main-codfw (kafka200*) due to errors in the logs (also lag metrics not displaying) |
[production] |
| 06:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1091 with low weight after reimage (duration: 00m 50s) |
[production] |
| 05:34 |
<marostegui> |
Deploy sanitarium events on db1124 - T190704 |
[production] |
| 05:23 |
<marostegui> |
Stop MySQL on db1091 for reimage |
[production] |
| 05:22 |
<marostegui> |
Deploy schema change on db1113:3316 - T191316 T192926 T195193 T89737 |
[production] |
| 05:22 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 for alter table (duration: 00m 52s) |
[production] |
| 02:12 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@0346959]: Update mobileapps to 5ea008c (duration: 00m 42s) |
[production] |
| 02:11 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@0346959]: Update mobileapps to 5ea008c |
[production] |