751-800 of 10000 results (15ms)
2014-03-25 §
15:31 <apergos> snapshot1-4 in pmtpa powered off, decom :-) [production]
09:27 <paravoid> elevated 503 levels cause seems to be a single spambot with multiple IPs POSTing malformed requests [production]
03:09 <springle> shutting down pc[123] for decom (pmtpa parser cache) [production]
02:48 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Mar 25 02:48:08 UTC 2014 (duration 48m 7s) [production]
02:19 <LocalisationUpdate> completed (1.23wmf19) at 2014-03-25 02:19:52+00:00 [production]
02:11 <LocalisationUpdate> completed (1.23wmf18) at 2014-03-25 02:11:10+00:00 [production]
00:07 <catrope> synchronized php-1.23wmf19/extensions/Wikidata/ [production]
00:07 <catrope> synchronized php-1.23wmf19/extensions/VisualEditor [production]
00:06 <catrope> synchronized php-1.23wmf18/extensions/VisualEditor [production]
2014-03-24 §
23:57 <mutante> ms5 - removed from icinga,puppet,storedconfigs,salt... [production]
23:51 <ori> Switched CentralNotice to GeoIP cookie rather than bits.wm.o/geoiplookup script tags [production]
23:43 <awight> update tools from de586ae4ad03be52da1bb24177ea4bf7cdbd2c94 to 2cfc441a9e5d2de3cc892d0077603579b220ac0e [production]
23:26 <ori> synchronized wmf-config/CommonSettings.php 'I42e9c8c97: CentralNotice: Re-set $wgCentralGeoScriptURL to false' [production]
23:25 <ori> updated /a/common to {{Gerrit|I42e9c8c97}}: CentralNotice: Re-set $wgCentralGeoScriptURL to false [production]
23:17 <ori> synchronized php-1.23wmf19/extensions/Wikidata 'I6ffb304d3: Update Wikidata' [production]
22:57 <bd808> Forced /srv/scap to update to c771a46 across the cluster [production]
20:07 <subbu> deployed Parsoid fa03dd20 with deploy repo sha e4d28e7e [production]
19:55 <mutante> DNS update - removing tampa search pools and searchidx2 [production]
19:36 <mutante> shutdown searchidx2 [production]
19:23 <ottomata> stopping hadoop service on analytics1020 and shutting down for move to Row D [production]
19:19 <mutante> searchidx2 - revoked puppet cert,remove from puppet,icinga,salt... [production]
19:02 <ottomata> stopping hadoop services on analytics1019 and shutting it down for move to Row D [production]
18:22 <springle> synchronized wmf-config/db-eqiad.php 's5 db1037 full steam' [production]
14:31 <ottomata> stopping hadoop services and shutting down analytics1018 [production]
03:03 <springle> synchronized wmf-config/db-eqiad.php 's5 repool db1037 warm up' [production]
02:41 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Mar 24 02:41:13 UTC 2014 (duration 41m 12s) [production]
02:17 <LocalisationUpdate> completed (1.23wmf19) at 2014-03-24 02:17:32+00:00 [production]
2014-03-23 §
02:41 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Mar 23 02:41:21 UTC 2014 (duration 41m 20s) [production]
02:17 <LocalisationUpdate> completed (1.23wmf19) at 2014-03-23 02:17:16+00:00 [production]
02:09 <LocalisationUpdate> completed (1.23wmf18) at 2014-03-23 02:09:42+00:00 [production]
2014-03-22 §
02:44 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Mar 22 02:43:56 UTC 2014 (duration 43m 55s) [production]
02:18 <LocalisationUpdate> completed (1.23wmf19) at 2014-03-22 02:18:55+00:00 [production]
02:11 <LocalisationUpdate> completed (1.23wmf18) at 2014-03-22 02:11:01+00:00 [production]
01:33 <K4-713> updated prod civi to 21b69b3d5df6cd22 [production]
00:17 <K4-713> synchronized payments to 9227c8f1b7a128bb5585 [production]
2014-03-21 §
22:13 <K4-713> updated prod civicrm to 2b635c1f5cf7 [production]
22:01 <K4-713> updated prod civicrm to c736116cac50121d [production]
19:23 <mutante> torrus was broken. going through fix per https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem [production]
18:14 <mutante> DNS update - adding zero.wikimedia.org [production]
18:05 <mutante> disabled and commented mobile2-5 in pmtpa pybal [production]
18:00 <Krinkle> Reloading Zuul to deploy I20b4aa9159df7 [production]
17:54 <mutante> same for search_pool5, and setting search_prefix (search19/20) to disabled [production]
17:52 <mutante> removing search_pool4 from pmtpa pybal [production]
17:51 <mutante> removing owa1-3 from pmtpa pybal [production]
17:42 <mutante> removing pmtpa https from pybal (ssl1-4) [production]
17:23 <mutante> remove pmtpa bits (sq67-70) from pybal [production]
17:22 <Krinkle> Running deleteEqualMessages.php on wuuwiki (bug 43917 comment 23) [production]
14:08 <hashar> Jenkins: label labs slaves with hasJenkinsDebianGlue to build debian packages on them [production]
13:43 <hashar> Jenkins: installing jenkins-debian-glue and misc::package-builder on labs slaves. [production]
12:02 <akosiaris> upgrade jenkins-debian-glue to 0.8.1 on apt.wikimedia.org [production]