|
2014-02-06
§
|
| 16:48 |
<Nemo_bis> |
#Wikipedia and #Wikimedia wikis have been partly down for about 10 min, now recovered/ing |
[production] |
| 16:41 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |
| 16:07 |
<reedy> |
started scap: testwiki to 1.23wmf13 and build l10n cache |
[production] |
| 16:04 |
<reedy> |
started scap: testwiki to 1.23wmf13 and build l10n cache |
[production] |
| 16:00 |
<reedy> |
started scap: testwiki to 1.23wmf13 and build l10n cache |
[production] |
| 15:57 |
<hashar> |
restarted jenkins by mistake :-( |
[production] |
| 15:28 |
<reedy> |
updated /a/common to {{Gerrit|I1e5ea52ae}}: s2 increase db1024 load after warm up |
[production] |
| 13:13 |
<paravoid> |
US/Canada pacific states being served by ulsfo |
[production] |
| 12:43 |
<paravoid> |
pointing the rest of East Asia (except CN) to ulsfo |
[production] |
| 11:14 |
<hashar> |
jenkins: added label <tt>hasTox</tt> on integration-slave01.pmtpa.wmflabs. Will let us run tox based Jenkins jobs there. |
[production] |
| 11:03 |
<springle> |
synchronized wmf-config/db-eqiad.php 's2 increase db1024 load after warm up' |
[production] |
| 07:29 |
<Ryan_Lane> |
redeploying parsoid/deploy on wtp* |
[production] |
| 07:01 |
<springle> |
xtrabackup clone db1018 to db1009 (take #2) |
[production] |
| 06:48 |
<springle> |
synchronized wmf-config/db-eqiad.php 's2 pool db1024 warm up' |
[production] |
| 05:48 |
<ori> |
varnish on cp1054: CPU wait spiked at 05:27. dmesg|tail: XFS: possible memory allocation deadlock in kmem_alloc. not investigating further. |
[production] |
| 05:45 |
<ori> |
finished scap: no new code. testing scap changes. (again.) (duration: 05m 00s) |
[production] |
| 05:40 |
<ori> |
started scap: no new code. testing scap changes. (again.) |
[production] |
| 05:15 |
<springle> |
restart labsdb1003 mariadb instances |
[production] |
| 05:09 |
<Ryan_Lane> |
scratch that, will redploy parsoid/deploy in about an hour |
[production] |
| 05:08 |
<Ryan_Lane> |
redeploying parsoid/deploy on wtp* |
[production] |
| 04:28 |
<ori> |
finished scap: no new code. testing scap changes. (duration: 04m 35s) |
[production] |
| 04:24 |
<ori> |
started scap: no new code. testing scap changes. |
[production] |
| 03:22 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at 2014-02-06 03:22:26+00:00 |
[production] |
| 03:10 |
<springle> |
xtrabackup clone db1018 to db1024 |
[production] |
| 02:45 |
<springle> |
xtrabackup clone db1034 to db1009 |
[production] |
| 02:44 |
<LocalisationUpdate> |
completed (1.23wmf11) at 2014-02-06 02:44:10+00:00 |
[production] |
| 02:23 |
<springle> |
synchronized wmf-config/db-eqiad.php 's2 depool db1009 schema changes' |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.23wmf12) at 2014-02-06 02:21:47+00:00 |
[production] |
| 02:01 |
<springle> |
synchronized wmf-config/db-eqiad.php 's2 repool db1034 warm up' |
[production] |
| 01:06 |
<mutante> |
apt-get remove libnet-stomp-perl on neon, i just removed that from puppet but didn't think it should stay in as an "absent" package forever |
[production] |
| 01:01 |
<ori> |
finished scap: no-diff scap to test script changes (duration: 02m 34s) |
[production] |
| 00:58 |
<ori> |
started scap: no-diff scap to test script changes |
[production] |
| 00:44 |
<ebernhardson> |
finished deploying Special:Notifications fix to Echo and Flow |
[production] |
| 00:44 |
<ebernhardson> |
synchronized php-1.23wmf11/extensions/Flow/ 'Update flow for Special:Notifications fix' |
[production] |
| 00:43 |
<ebernhardson> |
synchronized php-1.23wmf11/extensions/Echo/ 'Update echo for Special:Notifications fix' |
[production] |
| 00:38 |
<ebernhardson> |
synchronized php-1.23wmf12/extensions/Flow/ 'Update flow for Special:Notifications fix' |
[production] |
| 00:37 |
<ebernhardson> |
synchronized php-1.23wmf12/extensions/Echo/ 'Update echo for Special:Notifications fix' |
[production] |
| 00:04 |
<ori> |
finished scap: (no message) (duration: 29m 26s) |
[production] |
| 00:04 |
<ori> |
rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |
|
2014-02-05
§
|
| 23:34 |
<ori> |
started scap: (no message) |
[production] |
| 22:11 |
<ottomata> |
stopping puppet on analytics1021. Trying to get it to catch up on replica lag |
[production] |
| 20:13 |
<mwalker> |
updated fundraising civicrm from ec1e1fc75193ac8c0e6237fc0b80f58b3f8d55fc to 309a69545b4c89b323bffc500f71bdee82c35e42 for logging updates |
[production] |
| 18:57 |
<yurik> |
synchronized php-1.23wmf12/extensions/ZeroRatedMobileAccess/ |
[production] |
| 18:49 |
<yurik> |
synchronized php-1.23wmf11/extensions/ZeroRatedMobileAccess/ |
[production] |
| 18:38 |
<yurik> |
synchronized docroot/bits/WikipediaMobileFirefoxOS |
[production] |
| 14:11 |
<paravoid> |
ms-be1002/sdd: megacli -DiscardPreservedCache, -CfgEachDskRaid0, puppet run |
[production] |
| 13:57 |
<paravoid> |
remove XO-Level3 avoided as-path from cr1/2-eqiad despite no ticket reply; seems to work now |
[production] |
| 13:57 |
<hashar> |
compressing Jenkins console logs on gallium.wikimedia.org using gzip -9 |
[production] |
| 08:47 |
<ori> |
finished scap: (no message) (duration: 03m 31s) |
[production] |
| 08:47 |
<ori> |
rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |