1451-1500 of 2995 results (8ms)
2014-07-30 §
09:42 <hashar> bastion had broken puppet because deployment_server and zuul both declare the same python packages {{gerrit|150501}} [releng]
09:40 <hashar> restoring on puppetmaster modules/mediawiki/templates/apache/apache2.conf.erb which got deleted somehow [releng]
09:29 <hashar> Rebooting apache01/02 to see whether it fix the ssh connection issue [releng]
09:27 <hashar> manually started hhvm on mediawiki01 [releng]
09:25 <hashar> rebooting deployment-mediawiki01 hhvm process went zombie [releng]
09:23 <hashar> restarting hhvm on mediawiki 01/02 [releng]
09:05 <hashar_> Beta scap script broken since 6:30am UTC https://integration.wikimedia.org/ci/job/beta-scap-eqiad/ [releng]
2014-07-29 §
22:56 <cscott> updated OCG to version aeb8623d6ebe41ae7c7e36c57844bd9ea8e6d595 [releng]
21:02 <bd808> Converted deployment-sentry2.eqiad.wmflabs to use beta salt/puppet master [releng]
19:14 <hashar> Removed all jobs from queue, restarted slave agent. Update Jobs coming back [releng]
19:09 <hashar> deployment-bastion jenkins slave is stuck. Beta cluster is no more updating code :-// [releng]
15:58 <godog> restarted hhvm on deploymnet-mediawiki01 [releng]
15:52 <godog> restarted hhvm on deployment-mediawiki02 [releng]
15:50 <godog> installed libevent-dbg on deployment-mediawiki02 to capture an hhvm backtrace [releng]
15:17 <bd808> _joe_ restarting hhvm on deployment-mediawiki01 [releng]
15:00 <bd808> Apache stuck with 65 children on both deployment-mediawiki servers [releng]
10:37 <hashar> Restarted hhvm on mediawiki{01,02} [releng]
2014-07-28 §
17:41 <bd808> Updated hhvm to latest 3.3-dev+20140728 build on deployment-mediawiki0[12] [releng]
15:37 <manybubbles> rebuilding elasticsearch indexes to build a weighted all field we'll try to use to improve performance [releng]
15:32 <bd808> Restarted hhvm on deployment-mediawiki0[12]. All apache children were stuck waiting for hhvm to respond. [releng]
15:20 <bd808> Restarted apache on deployment-mediawiki02. 65 children and non-responsive to requests. (same as mediawiki01) [releng]
15:18 <bd808> Restarted apache on deployment-mediawiki01. 65 children and non-responsive to requests. [releng]
14:23 <manybubbles> or not - looks like I can't! [releng]
14:22 <manybubbles> reubilding cirrus search indexes to pick up a speed up all field [releng]
08:30 <hashar> restarted varnish on deployment-cache-bits01 . Hoping to clear bits cache [releng]
2014-07-25 §
18:29 <bd808> Added twentyafterfour and several other WMF staff to under_NDA sudo group [releng]
17:15 <bd808> Morebots is back! [releng]
09:45 <mwalker> rebasing puppet repo to get a ocg patch [releng]
2014-07-24 §
16:09 <bd808> Reverted MW config to re-enable luasandbox mode; back to luastandalone for now [releng]
15:44 <bd808> Updated MW config to re-enable luasandbox mode [releng]
15:43 <bd808> Updated hhvm-luasandbox to 2.0-3 and restarted hhvm instances [releng]
14:21 <hashar> killed hhvm process on deployment-mediawiki01 and 02. init script does not work. [releng]
02:59 <ori> promoted legoktm to project-admin [releng]
2014-07-23 §
23:30 <bd808> Running `find . -type d -exec chmod 777 {} +` in /data/project/upload7 to finx shared image dir permisisons [releng]
20:49 <bd808> Changed config to run lua via external executable to avoid hhvm crashing bug [releng]
16:20 <bd808> hhvm upgraded to 3.1+20140723-1+wmf1 on deployment-mediawiki0[12] [releng]
15:34 <bd808> Reverted hhvm to 3.1+20140630-1+wm1 on deployment-mediawiki02 [releng]
15:21 <bd808> Upgraded hhvm to 3.1+20140630; seeing problems with luasandbox extension [releng]
2014-07-22 §
14:26 <hashar> upgrading varnish on deployment-cache-mobile03 [releng]
14:22 <hashar> upgrading varnish on deployment-cache-text02 [releng]
14:02 <hashar> rebooting deployment-cache-upload02 varnish not happy with memory mapping [releng]
13:51 <hashar> rebooting bits varnish cache [releng]
13:43 <hashar> rebased puppetmaster repo. Rebase got broken after ''0317463 - beta: New script to restart apaches'' got merged in. [releng]
13:35 <hashar> apt-get upgrade on deployment-cache-bits01 + varnish upgrade [releng]
09:28 <hashar> Removing role::beta::natfix that is now handled by labs DNS and the class is removed with {{gerrit|146091}} [releng]
2014-07-21 §
23:37 <ori> Switched over beta cluster app servers to HHVM [releng]
21:27 <bd808> Killed update.php jobs; Antoine will give jobs a longer timeout [releng]
21:23 <bd808> Running update.php for simplewiki in screen [releng]
21:22 <bd808> Running update.php for hewiki in screen [releng]
21:21 <bd808> Running update.php for eswiki in screen [releng]