|
2013-12-10
§
|
| 14:01 |
<hashar> |
synchronized php-1.23wmf6/extensions/ProofreadPage |
[production] |
| 12:39 |
<paravoid> |
restarting parsoid across the cluster, 100% CPU on all appservers |
[production] |
| 07:33 |
<springle> |
synchronized wmf-config/db-eqiad.php 'explicit LB for each updateSpecialPages job' |
[production] |
| 05:35 |
<springle> |
synchronized wmf-config/db-eqiad.php 'db1049 to LB=0 except groupLoadsByDB' |
[production] |
| 04:17 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1049 after upgrade' |
[production] |
| 03:32 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1049 for upgrade' |
[production] |
| 03:15 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Dec 10 03:15:08 UTC 2013 |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.23wmf6) at Tue Dec 10 02:29:36 UTC 2013 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.23wmf5) at Tue Dec 10 02:15:52 UTC 2013 |
[production] |
| 00:25 |
<gwicke> |
reverted Parsoid proxy change as officewiki and some other https-only wikis were broken |
[production] |
| 00:14 |
<mflaschen> |
synchronized php-1.23wmf6/extensions/Thanks/ 'Deploy Thanks bugfix to 1.23wmf6' |
[production] |
| 00:04 |
<catrope> |
synchronized php-1.23wmf6/extensions/VisualEditor/ 'Update VisualEditor with cherry-picks' |
[production] |
|
2013-12-09
§
|
| 23:56 |
<mwalker> |
synchronized php-1.23wmf6/extensions/Collection/ 'Bisecting collection; found bad commit -- restoring to known bad until I figure out the correct way to pin this at the good commits or find the fix' |
[production] |
| 23:54 |
<mwalker> |
bad collection commit is 734de04a62a669022b3e7883301630f1e7947e78 -- now the only thing left is to figure out why! |
[production] |
| 23:53 |
<mwalker> |
synchronized php-1.23wmf6/extensions/Collection/ 'Bisecting collection (live), last bad; now on 734de04a62a669022b3e7883301630f1e7947e78' |
[production] |
| 23:51 |
<mwalker> |
synchronized php-1.23wmf6/extensions/Collection/ 'Bisecting collection (live), last bad; now on 484305e9ffb19d96155d3957240d74ff92992bb9' |
[production] |
| 23:51 |
<gwicke> |
updated Parsoid config to use the API service directly |
[production] |
| 23:50 |
<mwalker> |
synchronized php-1.23wmf6/extensions/Collection/ 'Bisecting collection (live), last bad; now on 93282cb9721316ee427c226b8f5c98274e79f4f0' |
[production] |
| 23:47 |
<mwalker> |
synchronized php-1.23wmf6/extensions/Collection/ 'Bisecting collection (live), last good; now on afec13ba4aef2f3f79cae0195744656833c5a1a7' |
[production] |
| 23:45 |
<mwalker> |
synchronized php-1.23wmf6/extensions/Collection/ 'Bisecting collection (live), now on 488d8daad500f4d9e9b400b6568ba170b54b0a70' |
[production] |
| 23:41 |
<mwalker> |
synchronized php-1.23wmf6/extensions/Collection/ 'Reverting collection (live) to b8a4d14eaca507022b011b979bfabe58bbc82361 from a4f97e428d32f4e6bf5adf88d628df9e49b4f075 to establish good revision' |
[production] |
| 23:01 |
<paravoid> |
rolling upgrade of nodejs to 0.10 on all wtp* boxes |
[production] |
| 22:59 |
<csteipp> |
synchronized php-1.23wmf5/extensions/CentralAuth 'Update CentralAuth to master for ops' |
[production] |
| 22:47 |
<LeslieCarr> |
moving bits-lb.esams from amslvs1 to amslvs3 |
[production] |
| 22:44 |
<paravoid> |
including new c-ares, libv8 & nodejs 0.10 in apt |
[production] |
| 21:06 |
<gwicke> |
deployed Parsoid 3191007575830, see https://www.mediawiki.org/wiki/Parsoid/Deployments |
[production] |
| 18:48 |
<manybubbles> |
synchronized wmf-config/InitialiseSettings.php 'readd cirrus to wikidata' |
[production] |
| 18:47 |
<paravoid> |
powercycling cp1065, unresposinve, no output on console |
[production] |
| 18:31 |
<manybubbles> |
finished scap: Updating messages after extension deploys missed it by syncing files and directories |
[production] |
| 18:06 |
<manybubbles> |
started scap: Updating messages after extension deploys missed it by syncing files and directories |
[production] |
| 17:57 |
<manybubbles> |
synchronized wmf-config/CirrusSearch-common.php 'Finally make Cirrus a beta feature' |
[production] |
| 17:56 |
<manybubbles> |
synchronized wmf-config/InitialiseSettings.php 'Set mediawiki.org as primary and prepare for cirrus as a beta feature' |
[production] |
| 17:49 |
<manybubbles> |
synchronized php-1.23wmf5/extensions/CirrusSearch 'Update Cirrus to master' |
[production] |
| 17:49 |
<manybubbles> |
synchronized php-1.23wmf5/extensions/BetaFeatures 'Update BetaFeatures so Cirrus can be a beta feature' |
[production] |
| 17:45 |
<manybubbles> |
synchronized php-1.23wmf6/extensions/CirrusSearch/ 'Update Cirrus to master' |
[production] |
| 17:44 |
<manybubbles> |
synchronized php-1.23wmf6/extensions/BetaFeatures/ 'Update BetaFeatures to master so Cirrus can be a beta feature' |
[production] |
| 15:54 |
<apergos> |
rebooting cp1065 (kmem_alloc) |
[production] |
| 15:00 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php 'touch' |
[production] |
| 15:00 |
<hashar> |
synchronized wmf-config/abusefilter.php '{{gerrit|96967}} (bug 57395) Add AbuseFilter rights to sysops on fiwiki' |
[production] |
| 14:38 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '{{gerrit|100372}} add protection level to articles in hewiki' |
[production] |
| 14:30 |
<hashar> |
synchronized php-1.23wmf5/.git/refs/heads/wmf/1.23wmf5 'bump Special:Version for aude' |
[production] |
| 14:07 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '{{gerrit|99030}} nomcom clean up' |
[production] |
| 14:04 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '{{gerrit|97458}} Change favicon for angwiktionary to w icon' |
[production] |
| 14:01 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '{{gerrit|86643}} skwikisource: Restrict uploads to sysops' |
[production] |
| 13:23 |
<hashar> |
synchronized docroot/bits/favicon 'updating favicons ( b0d4645..0812087 )' |
[production] |
| 13:18 |
<hashar> |
updating favicons by updating operations/mediawiki-config.git ( b0d4645..0812087 ) |
[production] |
| 09:36 |
<apergos> |
restart backend varnish on cp4019, out of memory (fork failed and other nice things) |
[production] |
| 09:25 |
<apergos> |
restarted opendj on sanger |
[production] |
| 09:12 |
<apergos> |
powercycled sq80, i/o errors for every command, fs complaints on various filesystems in dmesg, smells like controller but it booted ok so... |
[production] |
| 09:01 |
<apergos> |
powercycled ms-be1006, unresponsive, lots of "BUG: soft lockup - CPU#0 stuck for 22s!" etc from time it stopped responding (16.00 utc Sunday) |
[production] |