|
2013-11-15
§
|
| 06:42 |
<Tim> |
fixing broken cgroups on mw1038, mw1044, mw1091 |
[production] |
| 05:15 |
<ori> |
updated /a/common to {{Gerrit|I67a6d49d4}}: Beta Labs: set deployment-fluoride as $wgUDPProfilerHost |
[production] |
| 03:20 |
<Tim> |
on mc1001-1016: set timeout=0 in the redis soft state, as for rdb* |
[production] |
| 03:15 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri Nov 15 03:15:35 UTC 2013 |
[production] |
| 03:14 |
<Tim> |
on rdb1001-1004, set timeout=0 in the soft state, to match I8c9b13c1 |
[production] |
| 02:34 |
<LocalisationUpdate> |
completed (1.23wmf4) at Fri Nov 15 02:34:41 UTC 2013 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.23wmf3) at Fri Nov 15 02:15:18 UTC 2013 |
[production] |
| 00:39 |
<cmjohnson1> |
dns update |
[production] |
| 00:29 |
<mutante> |
schedule 1yr downtime for unused host 'gurvin' and all its services (RT #6135) and shutting it down |
[production] |
|
2013-11-14
§
|
| 22:05 |
<Nemo_bis> |
hashar> !log Gerrit: added marktraceur to group https://gerrit.wikimedia.org/r/#/admin/groups/539,members stream-events |
[production] |
| 21:59 |
<hashar> |
Gerrit: added marktraceur to group [https://gerrit.wikimedia.org/r/#/admin/groups/539,members stream-events] |
[production] |
| 21:46 |
<ori> |
synchronized docroot/bits/static-stable 'Correct 'static-stable' symlinks on bits' |
[production] |
| 21:45 |
<ori> |
synchronized docroot/bits/static-current 'Correct 'static-current' symlinks on bits' |
[production] |
| 21:43 |
<ori> |
updated /a/common to {{Gerrit|Id1a2bb2c8}}: Revert "Fix how 'current' branch is determined in updateBitsBranchPointers" |
[production] |
| 21:06 |
<hashar> |
vvvv {{bug|57064}} |
[production] |
| 21:05 |
<hashar> |
jenkins: migrated some phpcs job to use code sniffer style git-deployed on slaves in /srv/deployment/integration/mediawiki-tools-codesniffer/MediaWiki |
[production] |
| 21:03 |
<hashar> |
jenkins: migrated some phpcs job to use code sniffer style git-deployed on slaves in /srv/deployment/integration/mediawiki-tools-codesniffer/MediaWiki |
[production] |
| 20:49 |
<reedy> |
synchronized php-1.23wmf4/includes/ |
[production] |
| 20:48 |
<mark> |
Raised session_max on eqiad bits caches from 200k to 400k |
[production] |
| 20:45 |
<ori> |
synchronized php-1.23wmf3/resources/startup.js 'touch' |
[production] |
| 20:42 |
<ori> |
synchronized php-1.23wmf3/extensions/UniversalLanguageSelector 'Revert "Update UniversalLanguageSelector to b2f9e4211efc"' |
[production] |
| 20:26 |
<ori> |
synchronized php-1.23wmf3/extensions/UniversalLanguageSelector 'Update UniversalLanguageSelector to b2f9e4211efc' |
[production] |
| 20:19 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Phase 1 wikis to 1.23wmf4 |
[production] |
| 20:14 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.23wmf3 |
[production] |
| 20:12 |
<reedy> |
updated /a/common to {{Gerrit|I3034b1e4e}}: Add/update symlinks |
[production] |
| 20:05 |
<reedy> |
Finished syncing Wikimedia installation... : testwiki to 1.23wmf4 and build l10n cache |
[production] |
| 19:34 |
<reedy> |
Started syncing Wikimedia installation... : testwiki to 1.23wmf4 and build l10n cache |
[production] |
| 19:33 |
<mark> |
Changed IP addresses of upload-lb.eqiad.wikimedia.org |
[production] |
| 19:24 |
<RobH> |
18:50 not 13:30 durrrrr |
[production] |
| 19:19 |
<RobH> |
may have spoken too soon about ending, we shall see |
[production] |
| 19:18 |
<RobH> |
logging for record: outage started at approx 13:50 GMT, seems to have ended well, now-ish |
[production] |
| 19:00 |
<paravoid> |
pt-kill on s7 to kill LogPager queries |
[production] |
| 18:40 |
<cmjohnson1> |
dns update |
[production] |
| 18:38 |
<reedy> |
updated /a/common to {{Gerrit|I076d1eddf}}: CirrusSearch secondary for itwiki and plwiktionary |
[production] |
| 18:37 |
<reedy> |
synchronized docroot and w |
[production] |
| 18:36 |
<reedy> |
synchronized php-1.23wmf4/ |
[production] |
| 17:57 |
<reedy> |
synchronized php-1.23wmf3/extensions/Wikibase |
[production] |
| 17:23 |
<manybubbles> |
rebuilding all CirrusSearch indexes in place to get config updates |
[production] |
| 17:19 |
<hashar> |
Jenkins: updated code sniffer style from 574f68d to 0bebf0f7b |
[production] |
| 17:18 |
<manybubbles> |
synchronized wmf-config/InitialiseSettings.php 'plwiktionary and itwiki get cirrus as secondary' |
[production] |
| 17:14 |
<manybubbles> |
synchronized php-1.23wmf3/extensions/CirrusSearch/ 'Update CirrusSearch to master' |
[production] |
| 17:13 |
<manybubbles> |
synchronized php-1.23wmf2/extensions/CirrusSearch/ 'Update CirrusSearch to master' |
[production] |
| 16:45 |
<cmjohnson1> |
powering down analytics1009, analytics1011-13, analtyics1021, analytics1023 to relocate to rack A2 |
[production] |
| 16:06 |
<hashar> |
Gerrit/Git resetting mediawiki/extensions/Scribunto REL1_21 branch from fd1fbb4 to previous b5015a2. hexmode cherry-picked a bunch of changes from another branch/master instead of submitting a merge commit. |
[production] |
| 15:58 |
<apergos> |
preallocated cache files for amssq61 and 62 with ext4, this requires removing logbuf option in fstab |
[production] |
| 13:27 |
<faidon> |
synchronized wmf-config/filebackend.php 'switch multiMaster to swift-eqiad' |
[production] |
| 13:26 |
<faidon> |
updated /a/common to {{Gerrit|I898bfd6f1}}: filebackend: switch multiMaster to swift-eqiad |
[production] |
| 13:09 |
<apergos> |
preallocated cache file on amssq: 51, 52, 54, 56 59, 60 in addition to previously logged ones |
[production] |
| 13:02 |
<apergos> |
bad news: Nov 14 11:17:43 amssq54 kernel: [246380.560873] XFS: possible memory allocation deadlock in kmem_alloc (mode:0x250) and this host has the preallocated cache file |
[production] |
| 09:36 |
<ori-l> |
Manually replaced jquery.ba-bbq.js on nickel:/srv/org/wikimedia/ganglia-web-latest/js with <https://github.com/cowboy/jquery-bbq/pull/42>. Upstream maintainer unresponsive. |
[production] |