6401-6450 of 10000 results (28ms)
2014-04-15 §
16:30 <hashar> gallium had two Gerrit replications streams, one of them got removed {{gerrit|122419}} thus deleting the target directories under /var/lib/git [production]
16:22 <cmjohnson1> shutting down mw1163 to replace DIMM [production]
16:18 <cmjohnson1> swapping bad disk slot 4 on dataset1001 [production]
16:13 <paravoid> moving ms-fe3xxx/ms-be3xxx to private1-esams [production]
16:06 <ottomata> reinstalling elastic1009 [production]
15:21 <anomie> synchronized php-1.23wmf21/extensions/Flow 'SWAT: Flow: Prevent logspam on enwiki 125930' [production]
15:13 <anomie> synchronized php-1.23wmf21/extensions/Flow 'SWAT: Flow: Prevent logspam on enwiki 125930' [production]
15:02 <mutante> DNS update - removing Tampa service IPs [production]
13:52 <hashar> Jenkins compressing console logs of builds. On gallium as user jenkins : find /var/lib/jenkins/jobs -wholename '*/builds/*/log' -type f -exec gzip --best {} \\; [production]
13:42 <hashar> Command executed (as gerritslave user): find /srv/ssd/gerrit -type d -name '*.git' -exec bash -c 'echo; date; cd {}; echo; pwd; echo; git repack -ad; date;' \\; [production]
13:41 <hashar> Repacking Gerrit replicated repositories on lanthanum and gallium (both under /srv/ssd/gerrit/ ) [production]
13:13 <andrewbogott> shutdown and decommissioned virt12 [production]
12:19 <paravoid> adding ms-be101[345] to Swift eqiad's rings, at 33% weight; old rings kept at ms-fe1001:~/swift-2014-04-14 [production]
11:30 <mutante> DNS update - removed dbdump.pmtpa.wmnet [production]
11:26 <mutante> DNS update - remove db64,db65,db66,db67,db70 [production]
10:55 <mutante> db64,db67 - powerdown via mgmt [production]
10:51 <mutante> db65,db66 - shutdown [production]
10:07 <mutante> db70 - powerdown via mgmt [production]
09:47 <mutante> db64-67 - puppetstoredconfigclean.rb db${db}.pmtpa.wmnet ; puppetca --clean db${db}.pmtpa.wmnet ; salt-key -d db${db}.pmtpa.wmnet [production]
07:02 <springle> shutdown db67 for decom. analytics data is backed up on dbstore1002 [production]
06:47 <springle> moving pmtpa m1 and x1 slaves to db73 and db69 on 12th floor [production]
03:26 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Apr 15 03:25:52 UTC 2014 (duration 25m 51s) [production]
02:42 <LocalisationUpdate> completed (1.23wmf22) at 2014-04-15 02:42:48+00:00 [production]
02:23 <LocalisationUpdate> completed (1.23wmf21) at 2014-04-15 02:22:54+00:00 [production]
00:09 <gwicke> enabled wikinews family in Parsoid with temporary live patch to un-break VE deploy [production]
2014-04-14 §
23:43 <ori> Finished scap: (no message) (duration: 04m 31s) [production]
23:39 <ori> scap: php-1.23wmf22/extensions/VisualEditor 2b0979f...0652ad2 (I12e5c9751) [production]
23:38 <ori> Started scap: (no message) [production]
23:17 <ori> synchronized php-1.23wmf22/skins/vector/variables.less 'Ibcdaff017: Revert body font stack to be just sans-serif' [production]
23:15 <ori> synchronized wmf-config/InitialiseSettings.php 'I22f25730d: Enable VisualEditor for opt-in on Meta (2/2)' [production]
23:15 <ori> synchronized visualeditor.dblist 'I22f25730d: Enable VisualEditor for opt-in on Meta (1/2)' [production]
23:14 <ori> updated /a/common to {{Gerrit|I22f25730d}}: Enable VisualEditor for opt-in on Meta [production]
23:12 <ori> synchronized visualeditor.dblist 'I59f5a6e0b: Enable VisualEditor on French Wikinews' [production]
23:12 <ori> updated /a/common to {{Gerrit|I59f5a6e0b}}: Enable VisualEditor on French Wikinews [production]
22:56 <aaron> synchronized wmf-config/PoolCounterSettings-eqiad.php 'Limit large (djvu) file downloads for thumbnails' [production]
20:37 <mwalker> updating payments wiki for worldpay currencies (from af35b7b175bbe232d12464475cd33eef6fbefa94 to 8a93c17b320dea543b67e1dc63b33a5f70bcc884) [production]
20:13 <subbu> deployed Parsoid fba548cbf (deploy repo sha d0e12ddf) [production]
17:47 <paravoid> fixing /e/n/interfaces for static configuration: gadolinium hafnium labsdb1001 labsdb1002 labsdb1003 labstore1001 searchidx1001 ssl1005 ssl1006 ssl1009 virt1001 ytterbium [production]
17:37 <paravoid> fixing /e/n/interfaces for static configuration for cp40xx, lvs40xx [production]
17:14 <mutante> brewster - power down, could not revive due to disk or SATA controller fail [production]
16:57 <ottomata1> shutting down elastic1006 for reinstall [production]
16:45 <mutante> powering brewster back on [production]
16:40 <paravoid> powering up brewster [production]
16:13 <mutante> deleted old svn apache config on formey, started apache [production]
15:23 <paravoid> restarting virt0's salt-master, glance-api, glance-registry, keystone, nova-scheduler [production]
15:11 <manybubbles> synchronized wmf-config/CirrusSearch-common.php 'SWAT Cirrus update to improve performance' [production]
15:09 <manybubbles> synchronized php-1.23wmf21/extensions/CirrusSearch/ 'SWAT deploy to improve performance' [production]
14:48 <paravoid> upgrading all snapshot* hosts [production]
14:38 <paravoid> upgrading all packages & staggered restart of all of swift (ms-fe/ms-be) [production]
13:22 <reedy> synchronized php-1.23wmf22/includes/api/ApiFeedRecentChanges.php 'I268d0a53067738ba96bee74c593358b0b28cc083' [production]