3351-3400 of 10000 results (23ms)
2011-07-08 §
03:00 <Tim> deleting and recreating /usr/local/apache/common-local on all servers, to get mwdeploy ownership [production]
02:39 <Tim> updated sudoers.appserver and /h/w/b/sync-common-file to support the sync script changes [production]
02:33 <Tim> updated wikimedia-task-appserver manually on searchidx1, searchidx2, fenari, hume. Manually removed the php.ini-dist diversion on searchidx1, see CR r76095 [production]
02:00 <Tim> built wikimedia-task-appserver 2.2 for lucid, uploading to brewster, since we have some lucid boxes in production [production]
01:35 <Tim> uploading wikimedia-task-appserver 1.48 to brewster. Waiting for puppet to immediately wreak havoc in response. [production]
01:25 <Tim> re-enabled apache on srv255. Note that sync-file pushes to it will fail until I finish updating everything [production]
01:17 <Tim> did a test install of wikimedia-task-appserver version 1.48 on srv255 [production]
01:06 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 28221 rowikt sitename' [production]
00:56 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 29217 Add Portal namespace to Azerbaijani Wikisource' [production]
00:40 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 29381 Change title of Kannada wiktionary' [production]
00:34 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'revert' [production]
00:34 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 29381 Change title of Kannada wiktionary' [production]
00:30 <reedy> synchronized closed.dblist [production]
00:22 <reedy> synchronized php-1.17/wmf-config/CommonSettings.php 'fixing sitemap for fawikinews' [production]
00:21 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'fixing sitemap for fawikinews' [production]
2011-07-07 §
23:26 <Tim> temporarily stopping apache on srv255 for sync script testing [production]
22:59 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 26732' [production]
22:29 <reedy> synchronized php-1.17/wmf-config/abusefilter.php 'bug 29483' [production]
21:45 <Ryan_Lane> changing the spammer blocks from blocking post to blocking all requests [production]
21:22 <Ryan_Lane> dropping the weight of ms1004 to 5 [production]
21:15 <Ryan_Lane> upping weight of sq79 and sq82 [production]
21:14 <Ryan_Lane> repooling sq79 sq82 [production]
20:59 <Ryan_Lane> depooling sq79 and sq82 in lvs [production]
20:47 <Ryan_Lane> lowering carp weight of sq79 and 82 [production]
20:45 <Ryan_Lane> repooling sq79 and sq82 in lvs [production]
20:44 <Ryan_Lane> temporarily depooling sq79 and sq82 [production]
20:00 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 29360' [production]
18:47 <Ryan_Lane> adding another IP to that search block [production]
18:38 <Ryan_Lane> deploying new squid conf with a blocked ip, to block a search spammer [production]
18:04 <demon> synchronized php-1.17/wmf-config/InitialiseSettings.php 'More GNSM: had to set comment namespace and fallback category' [production]
17:59 <demon> synchronized php-1.17/wmf-config/InitialiseSettings.php 'GNSM for fawikinews: bug 29563' [production]
17:52 <Ryan_Lane> that's powering [production]
17:52 <Ryan_Lane> powing off srv154 [production]
17:51 <demon> synchronized php-1.17/extensions/GoogleNewsSitemap/GoogleNewsSitemap.alias.php [production]
16:39 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 27840, moving wiki' [production]
15:45 <mark> Established full iBGP mesh between cr1-sdtpa, csw5-pmtpa, cr1-eqiad, cr2-eqiad (NOT csw1-sdtpa) [production]
00:25 <awjr> disabling fundraising-related squid log filtering for udp2log [production]
2011-07-06 §
23:45 <Ryan_Lane> powercycling srv281 [production]
23:44 <Ryan_Lane> powercycling srv266 [production]
23:44 <Ryan_Lane> powercycling srv217 [production]
23:43 <Ryan_Lane> powercycling srv206 [production]
23:42 <Ryan_Lane> powercycling srv154 [production]
23:40 <Ryan_Lane> powercycling srv276, it's dead [production]
22:56 <mark> Setup cr1-sdtpa with initial config; connected to csw5-pmtpa (via L2 csw1-sdtpa); OSPF up [production]
22:36 <RobH> wmf_ops: you can disregard the humidity alarms for eqiad that are spamming alerts to email. eq confirms no humidity issue on site and I will investigate the actual sensors this friday [production]
22:21 <Ryan_Lane> repooling srv169, it was missing the wikimedia-lvs-realserver package. fixed in puppet [production]
22:04 <Ryan_Lane> rebooting srv169 [production]
21:59 <Ryan_Lane> depooling srv169 [production]
21:59 <Ryan_Lane> sync'd srv169, repooling to test [production]
21:54 <Ryan_Lane> depooling srv169 [production]