1901-1950 of 10000 results (22ms)
2014-01-03 §
09:50 <apergos> restarted parsoid on wtp1010 and 1023, several gigs of logs full of "Error: Can't set headers after they are sent." from ServerResponse.OutgoingMessage.setHeader [production]
07:37 <apergos> streber from mgmt console reports eth0 link down (hence it appears down to icinga and ganglia) [production]
07:06 <mark> Disabled OSPF3 on csw2-knams:xe-1/1/0.0 [production]
04:27 <Ryan_Lane> added python-keystone-redis to apt repo [production]
03:24 <springle> start schema changes for bug 59236, indexing only, ipblocks ipb_parent_block_id [production]
03:21 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Jan 3 03:20:58 UTC 2014 [production]
02:47 <LocalisationUpdate> completed (1.23wmf9) at Fri Jan 3 02:47:34 UTC 2014 [production]
02:18 <LocalisationUpdate> completed (1.23wmf8) at Fri Jan 3 02:17:55 UTC 2014 [production]
01:57 <reedy> finished scap: Fix Disambiguator hewiki magicwords [production]
01:30 <reedy> started scap: Fix Disambiguator hewiki magicwords [production]
00:23 <tstarling> synchronized wmf-config/CommonSettings.php [production]
00:02 <maxsem> synchronized php-1.23wmf9/extensions/MobileFrontend 'https://gerrit.wikimedia.org/r/105108' [production]
2014-01-02 §
22:43 <aaron> finished scap: active Timing test [production]
22:39 <aaron> started scap: active Timing test [production]
22:28 <reedy> synchronized echowikis.dblist 'Remove loginwiki' [production]
22:26 <reedy> updated /a/common to {{Gerrit|I2c2836d40}}: Rest of phase1 to 1.23wmf9 [production]
22:25 <aaron> finished scap: active Timing test [production]
22:14 <ori> loaded VCL change from Id54312fd5 (scholarship app) on cp1043 & cp1044 (misc-eqiad) [production]
22:03 <aaron> started scap: active Timing test [production]
21:31 <bsitu> synchronized php-1.23wmf9/extensions/Flow 'Update Flow to master' [production]
19:25 <Reedy> stuff has been broken [production]
19:25 <ori> restarted morebots [production]
2014-01-01 §
03:39 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed Jan 1 03:39:22 UTC 2014 [production]
03:10 <LocalisationUpdate> completed (1.23wmf7) at Wed Jan 1 03:10:51 UTC 2014 [production]
02:13 <LocalisationUpdate> completed (1.23wmf8) at Wed Jan 1 02:13:47 UTC 2014 [production]
2013-12-31 §
22:59 <ori> morebots went missing. job was active on toollabs but stuck. nothing useful in logs. restarted. [production]
11:59 <hashar> synchronized wmf-config/InitialiseSettings.php 'adding *.raa.se to the wgCopyUploadsDomains array {{gerrit|104683}}' [production]
07:39 <springle> resume schema changes for gerrit 51675 externallinks.el_id [production]
07:26 <aaron> finished scap: php-1.23wmf6 Timing test [production]
07:22 <aaron> started scap: php-1.23wmf6 Timing test [production]
05:26 <aaron> finished scap: php-1.23wmf6 Trying timing test again [production]
05:20 <aaron> started scap: php-1.23wmf6 Trying timing test again [production]
05:17 <springle> package upgrade sanitarium hosts db1053 db1054 db1057 [production]
03:23 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Dec 31 03:23:18 UTC 2013 [production]
03:21 <aaron> finished scap: php-1.23wmf6 Timing test [production]
03:01 <aaron> started scap: php-1.23wmf6 testing scap timing [production]
02:09 <awight> listeners updated from 1ebcfa83671b2caade50948f88c2be5cc9798692 to a4748700afaa4a7c5e9b84bfa1f78e3298e04ad1 [production]
01:06 <aaron> synchronized wmf-config/CommonSettings.php 'Disable MessageBlobStore::clear() via hook' [production]
01:04 <awight> updated tools from 874e7039a24f6fa1c23c9d30435dd4d5e9038906 to 7f91e78c211d3ba016e2fa469f1d7093540e18c1 [production]
00:24 <Aaron|home> Running a swift eqiad->tampa sync script (no-deletes) to catch any inconsistencies that built up [production]
00:14 <awight> tools updated from 64ae848b2518bc9e838b42dfbb894eb1eb845043 to 874e7039a24f6fa1c23c9d30435dd4d5e9038906 [production]
00:11 <maxsem> synchronized wmf-config/CommonSettings.php 'https://gerrit.wikimedia.org/r/103611' [production]
00:07 <maxsem> synchronized php-1.23wmf8/extensions/MobileFrontend 'https://gerrit.wikimedia.org/r/104682' [production]
2013-12-30 §
23:52 <awight> tools updated from from 47775021e832a5d1aa80a657086ccb4bc73d4577 to 64ae848b2518bc9e838b42dfbb894eb1eb845043 [production]
23:34 <awight> updated tools from dc39dfdb381d8279d995948f50cb5fe5b3b6de4c to 47775021e832a5d1aa80a657086ccb4bc73d4577 [production]
23:17 <aaron> synchronized wmf-config/filebackend.php 'Removed fileJournal config; this has been unused for some time' [production]
23:10 <hashar> Jenkins / gallium deleting build history from 2012 for operations* and mediawiki* jobs. That is running in a screen. [production]
23:05 <hashar> Jenkins purged build history of mediawiki-core-lint from before July 2013. [production]
22:57 <hashar> Jenkins on gallium, /var/lib/jenkins/jobs/mediawiki-core-lint/builds eventually reached the maximum possible number of file entries. Deleting a bunch [production]
22:44 <hashar> jenkins job mediawiki-core-lint is broken since 20:35 UTC roughly [production]