|
2017-02-16
§
|
| 17:03 |
<hashar> |
stopped puppet on contint1001 for https://gerrit.wikimedia.org/r/#/c/336978/ |
[production] |
| 16:30 |
<moritzm> |
uploaded HHVM 3.12.14 to apt.wikimedia.org |
[production] |
| 16:25 |
<jynus> |
SET GLOBAL thread_pool_size=64; on db1074's mariadb |
[production] |
| 16:01 |
<moritzm> |
upgrading mwdebug1002 to HHVM 3.12.14 |
[production] |
| 15:53 |
<moritzm> |
upgrading mwdebug1001 to HHVM 3.12.14 |
[production] |
| 14:27 |
<moritzm> |
uploaded openssl 1.1.0e to apt.wikimedia.org |
[production] |
| 13:28 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Change db2070 IP as it goes to another rack - T156478 (duration: 00m 41s) |
[production] |
| 13:27 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Change db2070 IP as it goes to another rack - T156478 (duration: 00m 56s) |
[production] |
| 13:19 |
<marostegui> |
Shutdown db2070 for maintenance - T156478 |
[production] |
| 10:18 |
<godog> |
roll-restart hhvm in eqiad to pick up fluorine -> mwlog1001 changes - T123728 |
[production] |
| 10:17 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic10(48|49|50|51|52).eqiad.wmnet |
[production] |
| 10:15 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic10(48|49|50|51|52).codfw.wmnet |
[production] |
| 09:39 |
<moritzm> |
installing libgc security updates on trusty systems |
[production] |
| 09:33 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2070 - T156478 (duration: 00m 41s) |
[production] |
| 08:44 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore origina db1082 weight - T158188 (duration: 00m 41s) |
[production] |
| 08:39 |
<godog> |
roll-restart jobrunner in codfw/eqiad to pick up fluorine -> mwlog1001 redis change - T123728 |
[production] |
| 07:54 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2060 - T156161 (duration: 00m 44s) |
[production] |
| 07:43 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase load db1082 - T158188 (duration: 00m 42s) |
[production] |
| 03:11 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Feb 16 03:11:01 UTC 2017 (duration 5m 42s) |
[production] |
| 03:05 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.12) (duration: 14m 27s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.11) (duration: 11m 46s) |
[production] |
| 00:59 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1082 with low load (duration: 00m 41s) |
[production] |
| 00:49 |
<eileen1> |
Update CiviCRM from 1ffc090b7a3d04883afb17ee0f6965cb0eeca14b to 20660c427552771d7006485840a22b92da60692e |
[production] |
| 00:12 |
<maxsem@tin> |
Synchronized php-1.29.0-wmf.12/extensions/Gadgets: https://gerrit.wikimedia.org/r/#/c/338004/ (duration: 00m 42s) |
[production] |
|
2017-02-15
§
|
| 22:59 |
<eileen1> |
update CIviCRM from da6ba1b46cafa71a4485dc299acce6d21bbe5e12 to 1ffc090b7a3d04883afb17ee0f6965cb0eeca14b |
[production] |
| 22:55 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.12/includes/libs/rdbms/ChronologyProtector.php: [[gerrit:338016|Add version to ChronologyProtector key]] T158217 (duration: 00m 41s) |
[production] |
| 22:52 |
<demon@tin> |
Synchronized php-1.29.0-wmf.12/extensions/Dashiki: prep-type stuff (duration: 00m 50s) |
[production] |
| 21:41 |
<ejegg> |
updated civicrm from 0fb289fd385f9f3a71df0c1dedbba8d1b5555730 to da6ba1b46cafa71a4485dc299acce6d21bbe5e12 |
[production] |
| 20:06 |
<mutante> |
contint1001 - logrotate --force /etc/logrotate.d/jenkins to test gerrit:337383 |
[production] |
| 19:50 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable Popups by default on se.wikimedia (T68374) (duration: 00m 41s) |
[production] |
| 18:59 |
<demon@tin> |
Synchronized multiversion/submodules.json: no-op (duration: 00m 50s) |
[production] |
| 18:30 |
<marostegui> |
Stop MySQL and shutdown db2062 for maintenance - T156478 |
[production] |
| 17:58 |
<jynus> |
stopping labsdb1005 mariadb + puppet in preparation for reimage |
[production] |
| 17:41 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.11/includes/libs/rdbms/ChronologyProtector.php: [[gerrit:337878|Make ChronologyProtector::init() use instanceof instead of empty()]] T158127 (duration: 00m 41s) |
[production] |
| 17:17 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: Group0 to 1.29.0-wmf.12 T155527 |
[production] |
| 17:08 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.12/includes/libs/rdbms/ChronologyProtector.php: [[gerrit:337848|Make ChronologyProtector::init() use instanceof instead of empty()]] T158127 (duration: 00m 43s) |
[production] |
| 17:05 |
<thcipriani> |
starting wmf.12 to group0 |
[production] |
| 16:39 |
<godog> |
flip xenon redis and apache from fluorine to mwlog1001 - T123728 |
[production] |
| 16:23 |
<Jeff_Green> |
authdns-update to deploy fundraising host rename db1008->frav1001 |
[production] |
| 16:16 |
<urandom> |
T155120: restarting Cassandra on restbase1007-a to enable Prometheus exporter (canary) |
[production] |
| 16:01 |
<dcausse@tin> |
Synchronized php-1.29.0-wmf.11/extensions/CirrusSearch/: T156234: Fold some problematic whitespaces with completion (duration: 01m 01s) |
[production] |
| 15:57 |
<marostegui> |
(Old action but for the sake of getting it logged) Force RAID controller to work on WriteBack even with the broken BBU it has now on db1060 so it can keep up with the replication thread - T158194 |
[production] |
| 15:51 |
<filippo@tin> |
Synchronized wmf-config/StartProfiler.php: Switch xenon redis to mwlog1001.eqiad.wmnet (duration: 00m 42s) |
[production] |
| 15:44 |
<hashar> |
Zuul reducing gate-and-submit minimum amount of changes to process from the wrong 12 down to 2. In case of repeating failures it would end up running jobs for only two jobs which would prevent cancelling jobs for up to 11 changes! |
[production] |
| 15:37 |
<jynus> |
stopping slave and repartitioning db1045 |
[production] |
| 14:45 |
<jynus> |
offlined 2 disks with media + other errors on db1060 |
[production] |
| 14:34 |
<marostegui> |
Stop MySQL and shutdown db1082 - T158188 |
[production] |
| 14:14 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1082 (duration: 00m 44s) |
[production] |
| 14:04 |
<hashar@tin> |
Synchronized php-1.29.0-wmf.12/extensions/CirrusSearch/includes/Maintenance/SuggesterAnalysisConfigBuilder.php: Fold some problematic whitespaces with completion - T156234 (duration: 00m 48s) |
[production] |
| 13:59 |
<elukey> |
disabled mod_deflate on bohrium (piwik) and disabled puppet. Testing 503 reduction. |
[production] |