4151-4200 of 10000 results (32ms)
2013-01-21 §
11:10 <apergos> nagios was dead over the weekend (config broken), fixed in puppet and on spence, now back in action [production]
09:57 <hashar> relaying Ryan: he restarted ldap on virt0 (was hung after server restart). nscld was properly falling back to virt1000 but ldap was stuck there too. DNS got restarted. [production]
09:52 <hashar> jenkins: jobs refresh completed. [production]
08:14 <hashar> jenkins: updating all Jenkins jobs based on d31c92e of integration/jenkins-job-builder-config.git [production]
05:51 <Tim> on marmontel: removed MW-specific packages php5-wmerrors, php-luasandbox, php-wikidiff2 [production]
02:50 <LocalisationUpdate> completed (1.21wmf8) at Mon Jan 21 02:50:20 UTC 2013 [production]
02:27 <LocalisationUpdate> completed (1.21wmf7) at Mon Jan 21 02:26:59 UTC 2013 [production]
2013-01-20 §
23:56 <tstarling> Finished syncing Wikimedia installation... : [production]
23:45 <tstarling> Started syncing Wikimedia installation... : [production]
23:40 <Ryan_Lane> rebooting virt0 to determine which dimm is bad [production]
19:57 <binasher> authdns scenario back to normal [production]
19:40 <LeslieCarr> deactivating 2828 as a preferred intermediate route between 14907 and 43821 [production]
19:30 <binasher> seeing major packetloss between esams and pmtpa, failing out of esams [production]
02:48 <LocalisationUpdate> completed (1.21wmf8) at Sun Jan 20 02:48:05 UTC 2013 [production]
02:25 <LocalisationUpdate> completed (1.21wmf7) at Sun Jan 20 02:25:48 UTC 2013 [production]
2013-01-19 §
22:24 <MaxSem> Created ProofredPage table on aswikisource [production]
19:22 <pgehres> synchronized wmf-config/reporting-setup.php 'Switching S:FundraiserStatistics read slave back to db1025' [production]
02:46 <LocalisationUpdate> completed (1.21wmf8) at Sat Jan 19 02:46:06 UTC 2013 [production]
02:24 <LocalisationUpdate> completed (1.21wmf7) at Sat Jan 19 02:24:18 UTC 2013 [production]
01:54 <binasher> testing completed, no longer sending live traffic to eqiad [production]
01:53 <binasher> i was sending >40 reqs/sec from europe and asia to eqiad apaches for the last hour for real world non-english testing [production]
00:27 <mutante> DNS update - add wikivoyager.org/.de [production]
00:08 <RobH> blog is fixed, in that its the software equivalent of spinning plates [production]
00:04 <RoanKattouw> Running git fsck on mediawiki/core.git as nobody on manganese [production]
2013-01-18 §
23:42 <RobH> blog is partly offline (unreliable loads) investigating [production]
23:38 <RobH> stupid w3 caching on blog won't let me use new wp-victor directory, has to match old .git name or caching errors result [production]
23:34 <RobH> blog is being bitchy about new theme versus old caching, reverting to stock and clearing local cache on marmontel [production]
23:26 <RobH> blog software updated a few hours ago, forgot to log. just updated theme to git update from gerrit repo. [production]
23:21 <asher> synchronized wmf-config/CommonSettings.php 'dc specific poolcounter conf' [production]
23:17 <notpeter> stopping all jobrunners including tmh boxes per asher's request while troubleshooting [production]
23:16 <mutante> DNS update to add wikimania.asia [production]
23:11 <asher> synchronized wmf-config 'eqiad/pmtpa config variances' [production]
22:37 <asher> synchronized wmf-config 'revert' [production]
22:36 <asher> synchronized wmf-config 'revert' [production]
22:34 <asher> synchronized wmf-config 'eqiad/pmtpa config variances' [production]
20:19 <root> Finished syncing Wikimedia installation... : [production]
19:49 <RobH> authdns-update colby back into sandbox [production]
19:08 <aaron> synchronized wmf-config/filebackend.php 'Added ceph file backend configuration' [production]
19:08 <root> Started syncing Wikimedia installation... : [production]
19:00 <mark> rm -rf /usr/local/apache/common-local on eqiad apaches [production]
18:54 <RobH> restarted pdns on linne, it borked on authdns-update [production]
18:48 <RobH> authdns-update [production]
18:17 <root> Finished syncing Wikimedia installation... : [production]
18:04 <root> Started syncing Wikimedia installation... : [production]
18:02 <root> Finished syncing Wikimedia installation... : [production]
18:00 <mark> Removed mw1085 from mediawiki_installation (acting up) [production]
17:54 <root> Started syncing Wikimedia installation... : [production]
17:27 <root> Started syncing Wikimedia installation... : [production]
16:11 <hashar> gallium jenkins: updated tools/fetch-mw-ext script to wipe the extension destination directory {{gerrit|44648}} updated: 09bbb44..e41843b [production]
16:00 <hashar> gallium jenkins: updated the tools/fetch-mw-ext script which was not properly fetching the extension. {{gerrit|44644}] updated: cfa82ff..09bbb44 [production]