201-250 of 10000 results (13ms)
2011-05-25 §
08:47 <apergos> restarted front and back end squids on sq81, front end was 20gb and back end was out to lunch [production]
08:35 <apergos> ekrem's root partition was full; cleared out some older logs from /var/log/apache2, compressed the most recently rotated (it had failed from disk full), reloaded puppet [production]
07:20 <Tim> set read_only=1 on db10, it's a slave so it should be read only. Nagios says it was broken for 6 months. [production]
07:07 <midom> synchronized php-1.17/wmf-config/db.php [production]
05:09 <Tim> restarted nagios IRC bot [production]
01:05 <Tim> created an account for myself in watchmouse [production]
00:48 <Andrew> Running populateBv2011EditCount.php in a screen on hume [production]
00:32 <Ryan_Lane> pruning binlogs on db9 [production]
2011-05-24 §
23:12 <pdhanda> synchronized php-1.17/wmf-config/InitialiseSettings.php 'Bug 29129. Added a namespace alias for metawiki.' [production]
20:36 <notpeter_> resyncing drbd nfs1 to nfs2 [production]
20:28 <RobH> mobile4 awaiting final configurations for service, mobile5 installation done, not yet run puppet updates [production]
20:20 <RobH> mobile4 is running puppet updates, mobile5 is mid-install [production]
19:46 <RobH> mobile4 & mobile5 racked and accessible for mgmt. installing OS on mobile4 now [production]
18:00 <Ryan_Lane> added new reverse zone for svc ips in esams; added entries for bits.svc.esams.wmnet and upload.svc.esams.wmnet [production]
17:31 <Ryan_Lane> removing bits-lb and upload-lb public ip enties, and adding bits.svc.pmtpa.wmnet and upload.svc.pmtpa.wmnet entries for https testing [production]
16:46 <mark> Upgraded cr2-eqiad to JUNOS 10.4R4.5 [production]
16:44 <mark> PIM configuration was missing on some virtual interfaces on csw1-sdtpa, which broke purging to esams. Put back in place [production]
16:09 <mark> Reloading re1.cr2-eqiad [production]
16:01 <mark> Fixed tunnel hack between pmtpa and eqiad [production]
15:01 <RobH> db20 networking restarted, back online [production]
12:05 <mark> Upgraded bootrom and software on asw-d1-sdtpa and asw-a5-sdtpa [production]
10:53 <mark> Copied existing 2.7.0.2 image to secondary flash, and installed 2.7.0.3a image on primary flash on csw5-pmtpa [production]
10:42 <mark> Copied existing 2.6.0 image to secondary flash, and installed 2.7.0.3a image on primary flash on csw1-sdtpa [production]
04:20 <demon> synchronized php-1.17/extensions/GoogleNewsSitemap/GoogleNewsSitemap_body.php 'r88707' [production]
04:03 <tstarling> synchronized php-1.17/wmf-config/InitialiseSettings.php [production]
04:03 <Tim> enabling GoogleNewsSitemap on enwikinews [production]
2011-05-23 §
21:18 <Ryan_Lane> added upload-lb.pmtpa.wm.o and bits-lb.pmtpa.wm.o addresses to reverse dns for https preparation [production]
19:32 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 29003' [production]
18:45 <apergos> reloading puppet on all hosts, with a minute sleep in between, running in screen on fenari as root. needed for enabling pluginsync on clients [production]
18:20 <Ryan_Lane> moved ipv6 proxy from iris to maerlant [production]
17:35 <RobH> db20 back online, needs mysql setup for replication on another cluster. created rt#836 [production]
17:29 <RobH> db20 was offline from earlier hardware issues that appear to have been resolved. it is in no current deployment group. booting it online to see if it requires reinstallation [production]
14:31 <demon> synchronized php-1.17/extensions/GoogleNewsSitemap/SitemapFeed.php [production]
14:31 <demon> synchronized php-1.17/extensions/GoogleNewsSitemap/FeedSMItem.php 'r88640' [production]
14:30 <demon> synchronized php-1.17/extensions/GoogleNewsSitemap/GoogleNewsSitemap_body.php 'r88640' [production]
14:23 <hcatlin> Deploying code update to Mobile wikipedia [production]
05:08 <Tim> in watchmouse: updated subversion monitoring, was broken since May 7 [production]
2011-05-22 §
17:47 <reedy> synchronized php-1.17/extensions/CodeReview/ui/CodeStatusChangeListView.php 'r88585' [production]
17:46 <reedy> synchronized php-1.17/extensions/CodeReview/ui/CodeCommentsListView.php 'r88585' [production]
00:09 <Reedy> Commons is back up and editable [production]
2011-05-21 §
23:38 <Reedy> Intermittant MySQL errors occuring on hits to 10.0.6.41, it is being looked into [production]
23:35 <Ryan_Lane> powercycling db31, it's dead [production]
10:27 <hashar> synchronized php-1.17/wmf-config/InitialiseSettings.php '25963 - Enable of Recent changes patrol for Serbian Wikisource (sr.wikisource.org)' [production]
2011-05-20 §
22:30 <Reedy> StewardWiki security issues fixed [production]
22:22 <reedy> synchronized php-1.17/wmf-config/InitialiseSettings.php 'Stewardwiki' [production]
21:23 <awjr> running contribution auditing scripts on civicrm.wikimedia.org [production]
21:21 <awjr> enabling log audit module on civicrm.wikimedia.org [production]
21:18 <awjr> svn up'ing to r183 of wikimedia branch on production instance of civicrm on grosley [production]
20:57 <pdhanda> ran sync-common-all 'Bug 28717. Group changes and flagged revs enabled for bnwiki' [production]
20:50 <Ryan_Lane> maerlant too [production]