|
2013-11-20
§
|
| 07:51 |
<apergos> |
rebooting sq37, we had /dev//sdc gone and reappeared as /dev/sdc killing back-end squid |
[production] |
| 07:40 |
<ori> |
synchronized php-1.23wmf3/extensions/WikimediaEvents/modules/ext.wikimediaEvents.moduleStorage.js 'Re-syncing I51d2d6495' |
[production] |
| 07:38 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents/modules/ext.wikimediaEvents.moduleStorage.js 'Re-syncing I51d2d6495' |
[production] |
| 06:47 |
<apergos> |
removed on mw* hosts from /tmp all *png/map/err/tif older than an hour, as some tmpfs were full |
[production] |
| 05:55 |
<ori-l> |
/tmp on Apaches filling up with math .pngs; moving some of the oldest away as a stopgap |
[production] |
| 05:04 |
<springle> |
synchronized wmf-config/db-pmtpa.php |
[production] |
| 03:17 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Nov 20 03:17:15 UTC 2013 |
[production] |
| 02:31 |
<LocalisationUpdate> |
completed (1.23wmf3) at Wed Nov 20 02:31:26 UTC 2013 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.23wmf4) at Wed Nov 20 02:15:34 UTC 2013 |
[production] |
| 01:38 |
<paravoid> |
rebooting ms-be1001, i/o stuck kernel bug |
[production] |
| 01:37 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents 'Update WikimediaEvents to I5b8cfe592' |
[production] |
| 01:35 |
<ori> |
synchronized php-1.23wmf3/resources/startup.js 'touch' |
[production] |
| 01:33 |
<ori> |
synchronized php-1.23wmf3/extensions/WikimediaEvents 'Update WikimediaEvents to I5b8cfe592' |
[production] |
| 00:43 |
<csteipp> |
synchronized php-1.23wmf4/extensions/OAuth 'update OAuth to master for last blocker fix' |
[production] |
| 00:33 |
<ori> |
synchronized php-1.23wmf3/resources/startup.js 'touch' |
[production] |
| 00:28 |
<ori> |
synchronized php-1.23wmf3/extensions/MobileFrontend 'Updating MobileFrontend for I3efc1fa64' |
[production] |
|
2013-11-19
§
|
| 23:58 |
<ori-l> |
Restarting EventLogging jobs on vanadium |
[production] |
| 23:54 |
<ori> |
synchronized php-1.23wmf3/resources/startup.js 'touch' |
[production] |
| 23:14 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'Iee7332c97: Disable infobox experiment' |
[production] |
| 23:13 |
<ori> |
updated /a/common to {{Gerrit|Iee7332c97}}: Disable infobox experiment |
[production] |
| 22:53 |
<reedy> |
synchronized php-1.23wmf4/extensions/AbuseFilter/ 'bug 57268' |
[production] |
| 21:59 |
<mholmquist> |
synchronized php-1.23wmf3/extensions/VectorBeta/ 'Sync VectorBeta code to wikis that will never use it' |
[production] |
| 21:45 |
<mholmquist> |
synchronized wmf-config/extension-list 'Add VectorBeta to extension-list' |
[production] |
| 21:44 |
<mholmquist> |
updated /a/common to {{Gerrit|Ib532e5558}}: Add VectorBeta to extension-list |
[production] |
| 21:41 |
<mholmquist> |
Finished syncing Wikimedia installation... : Adding VectorBeta |
[production] |
| 21:21 |
<mholmquist> |
synchronized php-1.23wmf4/extensions/VectorBeta/ |
[production] |
| 21:17 |
<mholmquist> |
Started syncing Wikimedia installation... : Adding VectorBeta |
[production] |
| 21:10 |
<mholmquist> |
synchronized wmf-config/InitialiseSettings.php 'Set wmgUseVectorBeta = true for phase0 wikis' |
[production] |
| 21:09 |
<mholmquist> |
synchronized wmf-config/CommonSettings.php 'Add wmgUseVectorBeta' |
[production] |
| 21:08 |
<mholmquist> |
updated /a/common to {{Gerrit|Ic3a64b434}}: Enable VectorBeta on group0 wikis |
[production] |
| 20:55 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 20:04 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents 'Update WikimediaEvents to d4f2a43' |
[production] |
| 20:04 |
<ori> |
synchronized php-1.23wmf3/extensions/WikimediaEvents 'Update WikimediaEvents to d4f2a43' |
[production] |
| 20:01 |
<ori> |
synchronized php-1.23wmf3/extensions/WikimediaEvents 'Update WikimediaEvents to d4f2a43' |
[production] |
| 20:00 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents 'Update WikimediaEvents to d4f2a43' |
[production] |
| 19:49 |
<reedy> |
synchronized php-1.23wmf3/extensions/MassMessage 'Update to master' |
[production] |
| 19:39 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents 'Update WikimediaEvents to 4aa9c629e5: Controlled experiment to assess performance of module storage' |
[production] |
| 19:37 |
<ori> |
synchronized php-1.23wmf3/extensions/WikimediaEvents 'Update WikimediaEvents to 4aa9c629e5: Controlled experiment to assess performance of module storage' |
[production] |
| 19:22 |
<reedy> |
synchronized wmf-config/ 'Enable MassMessage Ib29cb042e739e26fc5ef56f41317454ea690d0cb' |
[production] |
| 19:08 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: https://gerrit.wikimedia.org/r/96297 |
[production] |
| 19:07 |
<reedy> |
updated /a/common to {{Gerrit|I9b48be4c0}}: try to reduce "no working slave" notice flood in pmtpa dberror.log (attempt 2) |
[production] |
| 18:53 |
<Nemo_bis> |
but now ok |
[production] |
| 18:48 |
<Nemo_bis> |
kaulen overloaded at 100 % CPU since 5 min ago, bugzilla almost unusable |
[production] |
| 18:32 |
<ori> |
synchronized php-1.23wmf4/resources/mediawiki/mediawiki.js 'Id2835eca4: Enable module storage for 0.05% of visitors w/storage-capable browsers' |
[production] |
| 18:31 |
<ori> |
synchronized php-1.23wmf3/resources/mediawiki/mediawiki.js 'Id2835eca4: Enable module storage for 0.05% of visitors w/storage-capable browsers' |
[production] |
| 17:35 |
<LeslieCarr> |
added palladium as a salt master for common-infrastructure4 firewall |
[production] |
| 17:34 |
<LeslieCarr> |
CV71028 flapped again |
[production] |
| 17:32 |
<LeslieCarr> |
FPL link CV71028 flapped 20 minutes ago |
[production] |
| 11:56 |
<apergos> |
powercycled ms-be1002, couldn't get in (lots of BUG: soft lockup - CPU#18 stuck for 22s etc on console) |
[production] |
| 11:25 |
<akosiaris> |
remove puppetmaster and apache packages from sockpuppet. It no longer is a puppetmaster |
[production] |