|
2018-04-10
§
|
| 17:22 |
<papaul> |
shutting down cp2022 for main board replacement |
[production] |
| 17:20 |
<awight@tin> |
Finished deploy [ores/deploy@d35a1e6]: Test deploy virtualenv on ores1001, with logging and forced failure (duration: 02m 44s) |
[production] |
| 17:17 |
<awight@tin> |
Started deploy [ores/deploy@d35a1e6]: Test deploy virtualenv on ores1001, with logging and forced failure |
[production] |
| 17:07 |
<awight@tin> |
Finished deploy [ores/deploy@1e18fa6]: Test deploy virtualenv on ores1001, with logging (duration: 02m 28s) |
[production] |
| 17:05 |
<awight@tin> |
Started deploy [ores/deploy@1e18fa6]: Test deploy virtualenv on ores1001, with logging |
[production] |
| 16:57 |
<thcipriani> |
starting branch cut of 1.31.0-wmf.29 |
[production] |
| 16:45 |
<andrew@tin> |
Synchronized wmf-config/CommonSettings.php: disable new accounts on labtestwikitech (duration: 01m 00s) |
[production] |
| 16:26 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Change db2045 IP as it is being moved to another rack - T191193 (duration: 00m 59s) |
[production] |
| 16:25 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Change db2045 IP as it is being moved to another rack - T191193 (duration: 00m 59s) |
[production] |
| 16:21 |
<marostegui> |
Reload haproxy on dbproxy1010 to depool labsdb1011 |
[production] |
| 16:11 |
<marostegui> |
Stop MySQL on db2045 (s8 codfw master) to move it to another rack, this will break replication on codfw - T191193 |
[production] |
| 16:07 |
<bstorm_> |
labsdb1010 now has the latest views available, including the comment table |
[production] |
| 16:05 |
<marostegui> |
Reload haproxy on dbproxy1010 to repool labsdb1010 |
[production] |
| 15:42 |
<ottomata> |
disable puppet on analytics1003 and stop camus crons in preperation for spark 2 upgrade |
[production] |
| 15:32 |
<marostegui> |
Reload haproxy on dbproxy1010 to depool labsdb1010 |
[production] |
| 15:26 |
<vgutierrez> |
Reimage lvs5003 as stretch |
[production] |
| 15:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Change db2040 IP as it is being moved to another rack - T191193 (duration: 00m 59s) |
[production] |
| 15:21 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Change db2040 IP as it is being moved to another rack - T191193 (duration: 00m 59s) |
[production] |
| 15:08 |
<volans> |
restarting Icinga on einsteinium, command file not working |
[production] |
| 15:06 |
<bd808> |
Wiki replicas: ran `sudo maintain-views --table page_assessments --database arwiki` on all 3 servers for T191455 |
[production] |
| 14:46 |
<marostegui> |
Stop MySQL on db2040 for server move - T191193 |
[production] |
| 14:23 |
<volans> |
restarted nsca server on einsteinium |
[production] |
| 14:21 |
<vgutierrez> |
re-enable puppet on primary LVS |
[production] |
| 14:17 |
<moritzm> |
installing python-crypto security updates on trusty |
[production] |
| 13:55 |
<tgr@tin> |
Synchronized wmf-config/InitialiseSettings.php: T188198 Enable TemplateStyles on ruwiki (duration: 01m 00s) |
[production] |
| 13:51 |
<vgutierrez> |
disable puppet on primary LVS to merge safely gerrit/425040 T177961 |
[production] |
| 13:47 |
<zfilipin@tin> |
Synchronized php-1.31.0-wmf.28/extensions/AbuseFilter/: SWAT: [[gerrit:424767|Restore subtract method for backward compatibility (T191696)]] (duration: 01m 01s) |
[production] |
| 13:41 |
<moritzm> |
upgraded HHVM on mediawiki-deployment04/05/06 to a build with a patch for the MEMC_VAL_COMPRESSION_ZLIB flag in the memcached module (T184854) |
[production] |
| 13:35 |
<elukey> |
restart kafka on kafka-jumbo1001 for openjdk upgrades |
[production] |
| 13:32 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:425264|Revert "Update wikis with consolidate editing feedback" (T168886)]] (duration: 00m 59s) |
[production] |
| 13:29 |
<zfilipin@tin> |
Synchronized php-1.31.0-wmf.28/extensions/AbuseFilter/: SWAT: [[gerrit:424622|Disable search for global filters (T191539)]] (duration: 01m 01s) |
[production] |
| 13:19 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:425248|Update wikis with consolidate editing feedback (T168886)]] (duration: 01m 00s) |
[production] |
| 13:19 |
<ema> |
restart pybal on lvs1006 for config changes introduced by https://gerrit.wikimedia.org/r/#/c/425251/ |
[production] |
| 12:02 |
<moritzm> |
upgrading naos and wasat to ICU57-enabled build of HHVM |
[production] |
| 12:01 |
<_joe_> |
uploading mcrouter 0.37.0 to stretch-wikimedia (T190979) |
[production] |
| 11:59 |
<_joe_> |
uploading mcrouter 0.37.0 to jessie-wikimedia (T190979) |
[production] |
| 11:15 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@29df9db]: Use the MCS-provided content-type in the definition response - T191809 (duration: 24m 19s) |
[production] |
| 11:07 |
<moritzm> |
upgrading mwdebug servers in codfw to ICU57-enabled build of HHVM |
[production] |
| 10:51 |
<mobrovac@tin> |
Started deploy [restbase/deploy@29df9db]: Use the MCS-provided content-type in the definition response - T191809 |
[production] |
| 10:47 |
<arturo> |
T188266 reimage labtestservices2002.wikimedia.org |
[production] |
| 10:23 |
<moritzm> |
upgrading job runners in codfw to ICU57-enabled build of HHVM |
[production] |
| 09:29 |
<moritzm> |
upgrading app servers in codfw to ICU57-enabled build of HHVM |
[production] |
| 07:52 |
<hoo> |
Updated operations/dumps/dcat (7ea4e75c..61154ca4) on snapshot1007 |
[production] |
| 07:37 |
<moritzm> |
upgrading API servers in codfw to ICU57-enabled build of HHVM |
[production] |
| 05:49 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Remove db2069 from config - T191275 (duration: 00m 58s) |
[production] |
| 05:48 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Remove db2069 from config - T191275 (duration: 00m 59s) |
[production] |
| 05:17 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1067 after alter table (duration: 01m 11s) |
[production] |
| 05:17 |
<marostegui> |
Deploy alter table on s1 primary master (db1052) - T185128 T153182 |
[production] |
| 02:34 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.28) (duration: 05m 39s) |
[production] |