| 2009-02-26
      
      § | 
    
  | 21:02 | <mark> | Upgraded iLOM/BIOS on ms2 | [production] | 
            
  | 20:32 | <Rob> | restarted apache on srv193, srv197, srv201, srv217, srv223 | [production] | 
            
  | 20:28 | <Rob> | restarted apache on srv62, srv78, srv100, srv133, srv170, srv173, srv175, srv190 | [production] | 
            
  | 20:18 | <Rob> | restarted apache on srv135 and srv163 due to segfaults | [production] | 
            
  | 20:10 | <brion> | fixed up cache clear on pdf1. note we need to set up log rotation | [production] | 
            
  | 19:44 | <Rob> | nope, didnt break it, it worked.  Updated InitialiseSettings per bug 17295 Please allow sidebar links to be localisable for Wikimania 2009wiki | [production] | 
            
  | 19:44 | <Rob> | pushing a change per bug 17295 that could very well crash wikimania2009 wiki, lets find out!  =] | [production] | 
            
  | 19:41 | <brion> | merging r47836 to restrict 'pdf version' link in restricted mode | [production] | 
            
  | 19:37 | <mark> | Moved ms2 to internal vlan with new ips and dns entries | [production] | 
            
  | 19:28 | <brion> | testing rollout of PDF generation extension on en.wikipedia.org; with collection portal limited to logged-in users only | [production] | 
            
  | 19:19 | <Rob> | srv31 commented out of mediawiki-installation node group until its back online | [production] | 
            
  | 19:16 | <Rob> | updated mw-lib on pdf1, restarted pdf generation service | [production] | 
            
  | 19:16 | <Rob> | pdf generation offline for update | [production] | 
            
  | 18:17 | <brion> | srv31 appears to be a bit borked again. sigh. | [production] | 
            
  | 18:05 | <Rob> | Added wgRestrictDisplayTitle to InitialiseSettings to support bug 17307 Remove {{DISPLAYTITLE:}} restrictions for wm2009wiki.  Also removed the wgAllowDisplayTitle as it was an old testwiki flag that is no longer used. | [production] | 
            
  | 17:49 | <Rob> | Updated InitialiseSettings to support bug 17361 Enable DyanmicPageList for Wikimania2009wiki | [production] | 
            
  | 16:44 | <mark> | Brought BGP session to 2828 back up | [production] | 
            
  | 14:59 | <Rob> | updated InitialiseSettings for 17201 Enable the ability for crats on the Arbcom private wiki (English Wikipedia) to also remove crat and sysop | [production] | 
            
  | 14:47 | <Rob> | fixed change in InitialiseSettings for bug 17388 | [production] | 
            
  | 14:42 | <Rob> | rolling back change because I changed the wrong entry. | [production] | 
            
  | 14:29 | <Rob> | Implemented changes to Initilizesettings for bug 17388 Allow bureaucrats to revoke sysop status on UK chapter website | [production] | 
            
  | 11:13 | <mark> | Shut down BGP session to 2828, many reports of partial reachability, seemingly due to a broken link in a multipath | [production] | 
            
  | 06:12 | <Tim> | running gearmanRefreshLinks.php on all wikis with 20 worker threads | [production] | 
            
  
    | 2009-02-25
      
      § | 
    
  | 22:21 | <Andrew> | Deploying AbuseFilter to nowiki. | [production] | 
            
  | 18:58 | <mark> | Installed ms3 on 2 of the 4 bootable disk drives (sda and sdi), on a 80 GB RAID-1 root partition, leaving the rest of those 250 GB drives free, as well as the other 46 drives | [production] | 
            
  | 18:24 | <Rob> | srv215 deployed into service | [production] | 
            
  | 18:16 | <Rob> | installed and setting up srv215 | [production] | 
            
  | 18:08 | <brion> | merging r47809 live -- XSS fix for Collection extension | [production] | 
            
  | 18:01 | <brion> | temporarily halting apache on srv78, which seems to have some borkage with nfs mounts and nis | [production] | 
            
  | 17:55 | <brion> | srv78:  \tls: cannot access /mnt/upload5/wikipedia: No such file or directory | [production] | 
            
  | 17:53 | <Rob> | rename auth2 to sockpuppet in dns, pushed changes | [production] | 
            
  | 16:55 | <Rob> | fixed IP allocation for ms4 and ms3 | [production] | 
            
  | 16:55 | <Rob> | reset ms4 by accident due to IP misassignment on service processors for ms4 and ms3 | [production] | 
            
  | 05:29 | <Tim> | updated ApiQueryLogEvents.php to r47781 | [production] | 
            
  | 04:21 | <Tim> | killed long-running ApiQueryLogEvents queries on db4 (12000 seconds) | [production] | 
            
  | 01:11 | <Andrew> | Deployed AbuseFilter on dewiki per request of DaB | [production] | 
            
  | 01:08 | <Andrew> | adding AbuseFilter tables for dewiki | [production] | 
            
  | 00:03 | <brion> | running mw-serve cache cleaning on pdf1; cron job was borked by missing log file | [production] | 
            
  
    | 2009-02-24
      
      § | 
    
  | 22:46 | <Andrew> | Deployed AbuseFilter on metawiki. | [production] | 
            
  | 22:43 | <Andrew> | Adding abuse filter tables to metawiki. | [production] | 
            
  | 22:30 | <brion> | syncing merge of r47769 to fix regression in page history | [production] | 
            
  | 22:22 | <brion> | fix to disable slow tag search has had a side effect breaking page history. Should be tidied up in a few minutes. | [production] | 
            
  | 22:15 | <brion> | merging r47767 live to disable $wgUseTagFilter | [production] | 
            
  | 20:37 | <Rob> | updating dns for wikimedia.cz | [production] | 
            
  | 20:32 | <brion> | turning Collection/PDF on for all wikisources | [production] | 
            
  | 19:47 | <mark> | Shutting down Apache and unmounting /home on srv32, for puppet testing | [production] | 
            
  | 19:03 | <Rob> | updated wikibooks logo stuff per bug # 17034 | [production] | 
            
  | 17:13 | <brion> | just noting that TeliaSonera has a planned maintenance which may affect KNAMS connectivity for a few minutes around 2009-02-25 05:00 UTC. | [production] | 
            
  | 17:12 | <brion> | just noting that TeliaSonera has a planned maintenance which may affect KNAMS connectivity for a few minutes around 2009-02-25 05:00 UTC. | [production] | 
            
  | 16:51 | <brion> | restarting some dump threads on srv31 | [production] |