1751-1800 of 3274 results (14ms)
2014-07-28 §
15:18 <bd808> Restarted apache on deployment-mediawiki01. 65 children and non-responsive to requests. [releng]
14:23 <manybubbles> or not - looks like I can't! [releng]
14:22 <manybubbles> reubilding cirrus search indexes to pick up a speed up all field [releng]
08:30 <hashar> restarted varnish on deployment-cache-bits01 . Hoping to clear bits cache [releng]
2014-07-25 §
18:29 <bd808> Added twentyafterfour and several other WMF staff to under_NDA sudo group [releng]
17:15 <bd808> Morebots is back! [releng]
09:45 <mwalker> rebasing puppet repo to get a ocg patch [releng]
2014-07-24 §
16:09 <bd808> Reverted MW config to re-enable luasandbox mode; back to luastandalone for now [releng]
15:44 <bd808> Updated MW config to re-enable luasandbox mode [releng]
15:43 <bd808> Updated hhvm-luasandbox to 2.0-3 and restarted hhvm instances [releng]
14:21 <hashar> killed hhvm process on deployment-mediawiki01 and 02. init script does not work. [releng]
02:59 <ori> promoted legoktm to project-admin [releng]
2014-07-23 §
23:30 <bd808> Running `find . -type d -exec chmod 777 {} +` in /data/project/upload7 to finx shared image dir permisisons [releng]
20:49 <bd808> Changed config to run lua via external executable to avoid hhvm crashing bug [releng]
16:20 <bd808> hhvm upgraded to 3.1+20140723-1+wmf1 on deployment-mediawiki0[12] [releng]
15:34 <bd808> Reverted hhvm to 3.1+20140630-1+wm1 on deployment-mediawiki02 [releng]
15:21 <bd808> Upgraded hhvm to 3.1+20140630; seeing problems with luasandbox extension [releng]
2014-07-22 §
14:26 <hashar> upgrading varnish on deployment-cache-mobile03 [releng]
14:22 <hashar> upgrading varnish on deployment-cache-text02 [releng]
14:02 <hashar> rebooting deployment-cache-upload02 varnish not happy with memory mapping [releng]
13:51 <hashar> rebooting bits varnish cache [releng]
13:43 <hashar> rebased puppetmaster repo. Rebase got broken after ''0317463 - beta: New script to restart apaches'' got merged in. [releng]
13:35 <hashar> apt-get upgrade on deployment-cache-bits01 + varnish upgrade [releng]
09:28 <hashar> Removing role::beta::natfix that is now handled by labs DNS and the class is removed with {{gerrit|146091}} [releng]
2014-07-21 §
23:37 <ori> Switched over beta cluster app servers to HHVM [releng]
21:27 <bd808> Killed update.php jobs; Antoine will give jobs a longer timeout [releng]
21:23 <bd808> Running update.php for simplewiki in screen [releng]
21:22 <bd808> Running update.php for hewiki in screen [releng]
21:21 <bd808> Running update.php for eswiki in screen [releng]
21:21 <bd808> Running update.php for cawiki in screen [releng]
21:21 <bd808> Running update.php for commonswiki in screen [releng]
21:18 <hashar> Restarting upd2log-mw on deployment-bastion. There is a bunch of [python] <defunct> processes [releng]
17:32 <bd808> Updated scap to 4871208 (+ cherry pick of I6a56b5e) [releng]
17:12 <bd808> Hotfix for scap ssh host key checking to fix jenkins scap job [releng]
17:03 <bd808> Testing scap change I40a891b via cherry-pick [releng]
10:25 <hashar> on bastion, fixed some puppet dependency to have nutcracker to start with the proper configuration {{gerrit|148043}} [releng]
10:20 <hashar> upgrading packages on deployment-bastion [releng]
10:19 <hashar> deleted /var/lib/apt/lists/lock on bastion. Was prevent apt-get update from running [releng]
10:18 <hashar> setting up nutcracker on deployment-bastion. It was installed but the puppet class to configure it was not being applied. Related Gerrit patches: {{gerrit|148041}} and {{gerrit|148042}} [releng]
09:25 <hashar> rebooting deployment-apache02 [releng]
09:22 <hashar> rebooting deployment-apache01. [releng]
00:27 <ori> deployment-mediawiki01 & deployment-mediawiki02: configured for project-local puppet & salt masters [releng]
2014-07-18 §
00:30 <bd808> removed local l10nupdate user from deployment-jobrunner01 and deployment-videoscaler01 [releng]
00:22 <bd808> Killed stuck beta-update-databases-eqiad job ( stuck for over 60m waiting for executor; deadlock?) [releng]
00:21 <ori> beta broke due to I433826423. app servers load prod apache confs from /etc/apache2/wikimedia. temp fix: locally hack apache2.conf to load /usr/local/apache2/conf/all.conf; disable puppet. [releng]
2014-07-17 §
23:18 <bd808> Puppet broken for deployment-bastion by labs specific logic in misc::deployment::vars. [releng]
19:01 <mwalker> possibly breaking labs by cherry picking an apparmor patch that affects mysql https://gerrit.wikimedia.org/r/#/c/147027/ [releng]
2014-07-16 §
19:15 <mwalker> updated puppet about 20 minutes ago for new ocg variables (now officially in production puppet instead of just cherry picked) [releng]
2014-07-15 §
18:26 <bd808> Removed local mwdeploy user from /etc/passwd on deployment-videoscaler01 and deployment-jobrunner01 [releng]
16:59 <bd808> scap failing to deploymnet-videoscaler01 and deploymnet-jobrunner01 due to other random failures now. Lots of strange permissions errors during rsync [releng]