651-700 of 10000 results (16ms)
2013-01-21 §
16:30 <paravoid> repooling ms-fe1 [production]
16:29 <mark> Rerouted AS43821->AS14907 traffic [production]
15:48 <reedy> synchronized php-1.21wmf8/includes/EditPage.php [production]
15:45 <reedy> synchronized php-1.21wmf7/includes/EditPage.php [production]
15:32 <paravoid> depooling ms-fe1 for testing [production]
14:17 <hashar> gallium: manually installed pyflakes {{gerrit|44974}} [production]
11:10 <apergos> nagios was dead over the weekend (config broken), fixed in puppet and on spence, now back in action [production]
09:57 <hashar> relaying Ryan: he restarted ldap on virt0 (was hung after server restart). nscld was properly falling back to virt1000 but ldap was stuck there too. DNS got restarted. [production]
09:52 <hashar> jenkins: jobs refresh completed. [production]
08:14 <hashar> jenkins: updating all Jenkins jobs based on d31c92e of integration/jenkins-job-builder-config.git [production]
05:51 <Tim> on marmontel: removed MW-specific packages php5-wmerrors, php-luasandbox, php-wikidiff2 [production]
02:50 <LocalisationUpdate> completed (1.21wmf8) at Mon Jan 21 02:50:20 UTC 2013 [production]
02:27 <LocalisationUpdate> completed (1.21wmf7) at Mon Jan 21 02:26:59 UTC 2013 [production]
2013-01-20 §
23:56 <tstarling> Finished syncing Wikimedia installation... : [production]
23:45 <tstarling> Started syncing Wikimedia installation... : [production]
23:40 <Ryan_Lane> rebooting virt0 to determine which dimm is bad [production]
19:57 <binasher> authdns scenario back to normal [production]
19:40 <LeslieCarr> deactivating 2828 as a preferred intermediate route between 14907 and 43821 [production]
19:30 <binasher> seeing major packetloss between esams and pmtpa, failing out of esams [production]
02:48 <LocalisationUpdate> completed (1.21wmf8) at Sun Jan 20 02:48:05 UTC 2013 [production]
02:25 <LocalisationUpdate> completed (1.21wmf7) at Sun Jan 20 02:25:48 UTC 2013 [production]
2013-01-19 §
22:24 <MaxSem> Created ProofredPage table on aswikisource [production]
19:22 <pgehres> synchronized wmf-config/reporting-setup.php 'Switching S:FundraiserStatistics read slave back to db1025' [production]
02:46 <LocalisationUpdate> completed (1.21wmf8) at Sat Jan 19 02:46:06 UTC 2013 [production]
02:24 <LocalisationUpdate> completed (1.21wmf7) at Sat Jan 19 02:24:18 UTC 2013 [production]
01:54 <binasher> testing completed, no longer sending live traffic to eqiad [production]
01:53 <binasher> i was sending >40 reqs/sec from europe and asia to eqiad apaches for the last hour for real world non-english testing [production]
00:27 <mutante> DNS update - add wikivoyager.org/.de [production]
00:08 <RobH> blog is fixed, in that its the software equivalent of spinning plates [production]
00:04 <RoanKattouw> Running git fsck on mediawiki/core.git as nobody on manganese [production]
2013-01-18 §
23:42 <RobH> blog is partly offline (unreliable loads) investigating [production]
23:38 <RobH> stupid w3 caching on blog won't let me use new wp-victor directory, has to match old .git name or caching errors result [production]
23:34 <RobH> blog is being bitchy about new theme versus old caching, reverting to stock and clearing local cache on marmontel [production]
23:26 <RobH> blog software updated a few hours ago, forgot to log. just updated theme to git update from gerrit repo. [production]
23:21 <asher> synchronized wmf-config/CommonSettings.php 'dc specific poolcounter conf' [production]
23:17 <notpeter> stopping all jobrunners including tmh boxes per asher's request while troubleshooting [production]
23:16 <mutante> DNS update to add wikimania.asia [production]
23:11 <asher> synchronized wmf-config 'eqiad/pmtpa config variances' [production]
22:37 <asher> synchronized wmf-config 'revert' [production]
22:36 <asher> synchronized wmf-config 'revert' [production]
22:34 <asher> synchronized wmf-config 'eqiad/pmtpa config variances' [production]
20:19 <root> Finished syncing Wikimedia installation... : [production]
19:49 <RobH> authdns-update colby back into sandbox [production]
19:08 <aaron> synchronized wmf-config/filebackend.php 'Added ceph file backend configuration' [production]
19:08 <root> Started syncing Wikimedia installation... : [production]
19:00 <mark> rm -rf /usr/local/apache/common-local on eqiad apaches [production]
18:54 <RobH> restarted pdns on linne, it borked on authdns-update [production]
18:48 <RobH> authdns-update [production]
18:17 <root> Finished syncing Wikimedia installation... : [production]
18:04 <root> Started syncing Wikimedia installation... : [production]