751-800 of 10000 results (6ms)
2014-04-01 §
15:01 <hashar> Gerrit super slow again :-( [production]
14:46 <mutante> added oblivion to root-auth-keys [production]
14:17 <mutante> welcome new shell user oblivion [production]
14:04 <hashar> Gerrit flushed a few caches related to user accounts / LDAP [production]
13:43 <mutante> adding oblivion to ops and wmf LDAP groups [production]
08:44 <mutante> solr1/2 - revoke puppet certs [production]
08:43 <mutante> solr3 - delete salt key, puppet cert [production]
03:11 <springle> synchronized wmf-config/db-eqiad.php 's7 db1034 full steam' [production]
02:02 <LocalisationUpdate> failed: git pull of extensions failed [production]
01:58 <springle> killed research queries on db1047. email me [production]
01:35 <springle> restarted sanitarium s3 instance for additional private wikis [production]
00:59 <springle> synchronized wmf-config/db-eqiad.php 's7 repool db1034, warm up' [production]
2014-03-31 §
23:30 <springle> synchronized wmf-config/db-eqiad.php 's7 depool db1034 for upgrade' [production]
23:22 <ori> End of SWAT deploy. [production]
23:21 <ori> synchronized php-1.23wmf19/extensions 'I6f0f1b18d: Update MobileFrontend, PageImages and TextExtracts for bug 63248' [production]
23:16 <ori> synchronized php-1.23wmf20/extensions 'I6f0f1b18d: Update MobileFrontend, PageImages and TextExtracts for bug 63248' [production]
23:05 <ori> synchronized wmf-config/InitialiseSettings.php 'I532f8ee7c: Add "upload" custom debug group to $wgDebugLogGroups' [production]
23:05 <ori> updated /a/common to {{Gerrit|I532f8ee7c}}: Add 'upload' custom debug group to wgDebugLogGroups [production]
23:03 <ori> Starting SWAT deploy window. [production]
20:36 <awight> updated crm from 5151d97044ce2fff7299cee8920ee9bd3dbbdf54 to e726e4213f1d65cae7276f91379eb1b229b19134 [production]
19:31 <yurik> synchronized docroot/bits/WikipediaMobileFirefoxOS/ [production]
16:37 <aaron> synchronized wmf-config/PoolCounterSettings-eqiad.php 'Added "downloadpdf" pool counter config' [production]
16:11 <bd808> Upgraded kibana on logstash cluster to e317bc663495d0172339a4d4ace9c2a580ceed45 [production]
16:08 <mutante> DNS update - remove tampa search pools (a second time, was duplicate, heh) [production]
15:33 <Jeff_Green> reenable fundraising services, reenable silicon icinga monitoring [production]
14:28 <bd808> Started logstash on logstash1001 [production]
14:23 <bd808> Elasticsearch upgraded to 1.0.1 on logstash100[123] [production]
14:18 <hashar> beta cluster DNS entries migrated to point to the EQIAD datacenter. Keeping pmtpa instances around for a couple days [production]
14:16 <bd808> Stopped elasticsearch on logstash100[123] [production]
14:13 <bd808> Stopped logstash on logstash1001 [production]
13:48 <Jeff_Green> icinga alerts disabled for silicon [production]
13:34 <Jeff_Green> fundraising-system full-stop for hardware repairs on queue server [production]
11:57 <hashar> Jenkins: updating jslint jobs to run a PHP based json linter, will bails out whenever json files are invalid. {{bug|58279}} {{gerrit|113958}} [production]
10:48 <hashar> Jenkins fixed up browsertests jobs. Bundler could not compile gems on the eqiad slaves {{gerrit|122346}} [production]
09:46 <hashar> Jenkins: applied hasBrowserTests label on both labs slave. Unblocks the browser tests which were still tied to a deleted instance {{gerrit|122341}} [production]
07:23 <faidon> synchronized php-1.23wmf20/extensions/SpamBlacklist/SpamBlacklist.php 'revert I694860b - SpamBlacklist' [production]
07:22 <faidon> synchronized php-1.23wmf19/extensions/SpamBlacklist/SpamBlacklist.php 'revert I694860b - SpamBlacklist' [production]
05:47 <faidon> synchronized php-1.23wmf19/extensions/SpamBlacklist/SpamBlacklist.php 'local hack to test memcached traffic increase theory' [production]
03:08 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Mar 31 03:08:39 UTC 2014 (duration 8m 38s) [production]
02:30 <LocalisationUpdate> completed (1.23wmf20) at 2014-03-31 02:30:26+00:00 [production]
02:13 <LocalisationUpdate> completed (1.23wmf19) at 2014-03-31 02:13:38+00:00 [production]
2014-03-30 §
04:55 <springle> synchronized wmf-config/db-eqiad.php 's7 db1034 to full steam' [production]
03:11 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Mar 30 03:11:14 UTC 2014 (duration 11m 13s) [production]
02:31 <LocalisationUpdate> completed (1.23wmf20) at 2014-03-30 02:31:23+00:00 [production]
02:14 <LocalisationUpdate> completed (1.23wmf19) at 2014-03-30 02:14:34+00:00 [production]
2014-03-29 §
17:31 <reedy> synchronized wmf-config/InitialiseSettings.php 'touch' [production]
17:30 <reedy> synchronized database lists files: Update size related dblists [production]
17:28 <reedy> updated /a/common to {{Gerrit|I7e9595ce0}}: Prepare GeoData config for Elasticsearch switchover [production]
16:54 <Reedy> afl_namespace tinyint -> int on all medium wikis [production]
16:06 <hoo> 800+ connections open on db1021, db1037, db1045 (s5) [production]