401-450 of 699 results (6ms)
2008-12-03 §
19:13 <RobH> tested i/o on db17, issue where it pauses disk access is gone. [production]
19:02 <mark> Shutdown TeliaSonera (AS1299) BGP session, the link is flaky resuling in unidirectional traffic only for most of the day [production]
19:02 <RobH> replaced hardware in db17, reinstalled. [production]
18:58 <mark> Prepared search10, search11 and search12 as search servers [production]
17:26 <brion> investigating ploticus config breakage [[bugzilla:16085]] [production]
17:18 <brion> ploticus seems to be missing from most new apaches [production]
17:12 <RobH_DC> search10, search11, search12 racked and installed. [production]
14:29 <RobH_DC> srv136 was unresponsive, rebooted, synced, back in rotation. [production]
2008-12-02 §
23:33 <brion> scapping to update ContributionReporting ext [production]
23:11 <Tim> db7 wasn't deleting its relay logs for some reason, since August 21. Disk critical. Did a reset slave. [production]
20:03 <brion> rebuilt public_reporting with fixed encoding [production]
19:54 <brion> fudged charsets in triggers for donation db update, let's see if that helps [production]
12:11 <Tim> started squid (backend instance) on sq40, stopped for 13 days for no apparent reason [production]
12:08 <Tim> restarted apache on srv161, srv122, srv137, attempted on srv123 but it is waiting for dead NFS mount [production]
11:44 <Tim> took srv183 out of memcached rotation [production]
10:50 <Tim> purged binlogs on ixia and db1 (both critical) [production]
2008-12-01 §
23:49 <brion> sync-common-all'ing to add a wikispecies little icon for sul shared session login, since people keep asking for it :) [production]
20:31 <RobH> synced and restarted apache on srv89 [production]
19:33 <RobH> manually setup apache-check for pybal on srv138, synced, enabled. [production]
19:29 <RobH> manually setup the apache_check stuff for srv126 and pybal. [production]
17:19 <RobH> synced and restarted apache on srv176 & srv176 [production]
17:18 <RobH> did the sync and restart thing for apache on srv162 [production]
17:16 <RobH> synced and restarted apache on srv145 [production]
17:13 <RobH> synced and restarted apache on srv121 and srv125 [production]
17:00 <RobH> apache wasnt working on srv102 and srv106, restarted them after syncing [production]
15:10 <mark> Restarted stuck pdns_server on bayle, lots of stale selective_answer.py processes [production]
14:44 <domas> restored Roma article on itwiki, had orphaned revision entries after deleting it, manually inserted page entry [production]
14:40 <mark> Setup Telia transit at knams, but all inbound routes filtered [production]
14:35 <RobH> removed images from plwiki flaggedrevs per request from Leinad [production]
2008-11-30 §
12:14 <mark> restarted flapping apache on srv119, looks like memory corruption going on [production]
2008-11-28 §
18:58 <brion-holiday> updating User-Agent blacklists to block 'WebCapture' download tool but not the Library of Congress's www.loc.gov/webcapture/ spider [production]
18:17 <yksinaisyyteni> fixed broken upload/deletion/timeline on jawiki [production]
07:11 <JeLuF> succeeded to umount /mnt [production]
07:10 <JeLuF> killed hanging cron entries on db22. updatedb.mlocate. Might be related to broken mount db16:/a -> /mnt [production]
07:06 <JeLuF> killed lots of jobs running on db22, "SELECT /* ApiQueryBacklinks::run XX.XXX.XXX.X */ page_id,page_title,page_namespace,page_is_redirect" which were in status "copying to tmp table" [production]
2008-11-27 §
13:10 <mark> hungover, headache, lack of voice [production]
2008-11-26 §
17:00 <RobH> fixed flaggedrevs to work on ruwikiquote, due to my own mistake in earlier implementation, per https://bugzilla.wikimedia.org/show_bug.cgi?id=14863 [production]
02:38 <brion> updated Math.php to r43966 which both fixes 0-byte math PNGs and generates correct URLs *cough* [production]
02:36 <brion> broke math temporarily woops [production]
02:29 <brion> bumped Math.php to r43965 to hopefully clear out those 0-byte math images ([[bugzilla:16440]]) [production]
02:01 <brion> updating CentralNotice to r43962 to fix sitenames again :P [production]
01:57 <brion> poking centralNotice to r43961 for evil hacks to bump limits temporarily :D [production]
01:31 <brion> updating CentralNotice to r43959 [production]
2008-11-25 §
19:25 <brion> syncing update to CentralNotice [production]
18:28 <RobH> root password changed across all servers. if you didnt get a copy and you should have one, talk to another tech team member. [production]
17:58 <RobH> added bayes to allowed nfs connections to storage2, setup fstab for nfs mounts on bayes, revoked shell access for ezachte on storage2 (not needed for what he wanted) [production]
15:50 <RobH> updated some points for huwiki flaggedrevs and removed an outdated user group per https://bugzilla.wikimedia.org/show_bug.cgi?id=15568 [production]
15:38 <RobH> gave erik zachte login rights to storage2 [production]
15:16 <RobH> updated dns for survey software [production]
01:35 <brion> updating ContributionReporting ext [production]