|
2015-02-18
§
|
| 23:23 |
<ori> |
HHVM on mw1141 locked up (threads stuck in __lll_lock_wait). Depooling for further investigation. |
[production] |
| 23:17 |
<twentyafterfour> |
Finished scap: testwiki to php-1.25wmf18 and rebuild l10n cache (duration: 42m 58s) |
[production] |
| 22:34 |
<twentyafterfour> |
Started scap: testwiki to php-1.25wmf18 and rebuild l10n cache |
[production] |
| 22:30 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: rollback group0 to 1.25wmf17 |
[production] |
| 22:28 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf18 |
[production] |
| 22:24 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf17 |
[production] |
| 21:41 |
<subbu> |
deployed parsoid version 17f68256 |
[production] |
| 19:24 |
<bd808|LUNCH> |
pruned stale members from trebuchet minions set for scap/scap: redis-cli srem "deploy:scap/scap:minions" fenari.wikimedia.org virt0.wikimedia.org nickel.wikimedia.org searchidx1001.eqiad.wmnet |
[production] |
| 19:01 |
<godog> |
restart txstatsd on graphite1001 to flush old metrics |
[production] |
| 18:40 |
<ori> |
Synchronized wmf-config/CommonSettings.php: Id215ff962: Change $wgUDPProfilerPort to 8135. (duration: 00m 05s) |
[production] |
| 18:14 |
<oblivian> |
Synchronized wmf-config/session.php: mc1013 IP change (duration: 00m 05s) |
[production] |
| 18:11 |
<oblivian> |
Synchronized wmf-config/session.php: mc1013 IP change (duration: 00m 07s) |
[production] |
| 17:58 |
<_joe_> |
fixed scap on mw1158, moving /srv/deployment/scap away made puppet perform the redeploy |
[production] |
| 17:56 |
<_joe_> |
fixed scap on mw1154, moving /srv/deployment/scap away made puppet perform the redeploy |
[production] |
| 17:51 |
<bd808> |
fixing scap on mw1158 and mw1154 will take a root to fix bad trebuchet git clones -- cd /src/deployment/scap; sudo mv scap scap-broken; sudo salt-call deploy.fetch 'scap/scap'; sudo salt-call deploy.checkout 'scap/scap' |
[production] |
| 17:22 |
<_joe_> |
shutting down mc1014, moving to a different rack |
[production] |
| 17:19 |
<_joe_> |
mw1158 and mw1154 report broken python imports during scap |
[production] |
| 17:18 |
<oblivian> |
Synchronized wmf-config/session.php: mc1014 IP change (duration: 00m 07s) |
[production] |
| 17:18 |
<oblivian> |
Synchronized wmf-config/session.php: mc1014 IP change (duration: 00m 07s) |
[production] |
| 16:56 |
<demon> |
Synchronized README: testing scap update (duration: 00m 07s) |
[production] |
| 16:50 |
<_joe_> |
moving mc1014 to a new row |
[production] |
| 16:44 |
<oblivian> |
Synchronized wmf-config/session.php: mc1015 IP change (duration: 00m 05s) |
[production] |
| 16:16 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: translationadmin for sysops on mw.org (duration: 00m 08s) |
[production] |
| 16:03 |
<demon> |
Synchronized wmf-config/CommonSettings-labs.php: for completeness, no-op (duration: 00m 07s) |
[production] |
| 15:56 |
<oblivian> |
Synchronized wmf-config/session.php: mc1016 IP change (duration: 00m 07s) |
[production] |
| 15:25 |
<chasemp> |
phabricator updated for T86772 |
[production] |
| 15:11 |
<_joe_> |
shutting down mc1016 for movement to a new row |
[production] |
| 14:34 |
<demon> |
Synchronized wmf-config/CommonSettings.php: remove dl() of php_utfnormal (duration: 00m 07s) |
[production] |
| 10:33 |
<hoo> |
Manually switched wikidatawiki's sites table entry for ruwiki from protocol relative to https URIs |
[production] |
| 06:59 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1054 T89801 (duration: 00m 06s) |
[production] |
| 05:07 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Feb 18 05:06:53 UTC 2015 (duration 6m 52s) |
[production] |
| 02:39 |
<LocalisationUpdate> |
completed (1.25wmf17) at 2015-02-18 02:38:47+00:00 |
[production] |
| 02:38 |
<l10nupdate> |
Synchronized php-1.25wmf17/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.25wmf16) at 2015-02-18 02:22:02+00:00 |
[production] |
| 02:22 |
<l10nupdate> |
Synchronized php-1.25wmf16/cache/l10n: (no message) (duration: 00m 02s) |
[production] |
| 02:07 |
<ori> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 05s) |
[production] |
| 01:58 |
<springle> |
Synchronized wmf-config/db-eqiad.php: reduce db1065 load (duration: 00m 05s) |
[production] |
| 00:56 |
<maxsem> |
Synchronized php-1.25wmf17/extensions/MobileFrontend/: SWAT (duration: 00m 06s) |
[production] |
| 00:44 |
<maxsem> |
Synchronized wmf-config/: https://gerrit.wikimedia.org/r/189863 - labs only (duration: 00m 06s) |
[production] |
| 00:27 |
<maxsem> |
Synchronized php-1.25wmf16/extensions/WikiGrok/: https://gerrit.wikimedia.org/r/190562 (duration: 00m 06s) |
[production] |
| 00:26 |
<maxsem> |
Synchronized php-1.25wmf17/extensions/WikiGrok/: https://gerrit.wikimedia.org/r/190562 (duration: 00m 07s) |
[production] |
| 00:22 |
<maxsem> |
Synchronized wmf-config/mobile.php: https://gerrit.wikimedia.org/r/188731 (duration: 00m 05s) |
[production] |
| 00:21 |
<springle> |
db1043 m3-master restart mysqld T89274 |
[production] |
| 00:16 |
<maxsem> |
Synchronized wmf-config/mobile.php: https://gerrit.wikimedia.org/r/187823 (duration: 00m 06s) |
[production] |
| 00:13 |
<springle> |
db1048 m3-slave restart mysqld T89274 |
[production] |
| 00:11 |
<maxsem> |
Synchronized php-1.25wmf16/extensions/Echo/: SWAT (duration: 00m 06s) |
[production] |
| 00:05 |
<maxsem> |
Synchronized php-1.25wmf17/extensions/Echo/: SWAT (duration: 00m 07s) |
[production] |