7101-7150 of 10000 results (40ms)
2014-09-26 §
13:39 <akosiaris> moved mathoid to low-traffic lvs servers@eqiad [production]
12:49 <cscott> cleared OCG caches again when I woke up to buy me more time to investigate the issue properly. [production]
08:44 <awight> rollback: revision for civicrm locked to 06c9546f9b68f6ecbaaf510944418aa52f9ed0fb [production]
08:30 <_joe_> updated hhvm on mw1053, kicked the jr a couple of times, working again now [production]
08:29 <awight> large_donation schema migration 7000 [production]
08:28 <awight> skip over wmf_civicrm schema migration 7022 -- *why* did I make that unsafe [production]
08:24 <awight> fundraising_code_update: revision for civicrm changed from 06c9546f9b68f6ecbaaf510944418aa52f9ed0fb to 5aca00fd4573f0fe8f385baa7238172f6ae54438 [production]
08:19 <awight> disabling CRM jobs during deployment [production]
08:09 <cscott> cleared OCG queues and cache to quiet icinga; will try to get to the root cause tomorrow. [production]
07:41 <hashar> Updated our Jenkins Job Builder fork 2d74b16..686265a [production]
07:06 <ori> Synchronized php-1.24wmf22/extensions/WikimediaEvents: Update WikimediaEvents for 791e14cfc1d (duration: 00m 05s) [production]
06:53 <ori> Synchronized php-1.25wmf1/extensions/WikimediaEvents: Update WikimediaEvents for 0e087daea5 (duration: 00m 07s) [production]
06:41 <cscott> updated OCG to version f3a6c1cbba118d4a5e1aa019937dc50159fc823d [production]
04:43 <_joe_> updating bash, USN-2363 [production]
04:10 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Sep 26 04:10:12 UTC 2014 (duration 10m 11s) [production]
03:09 <LocalisationUpdate> completed (1.25wmf1) at 2014-09-26 03:09:47+00:00 [production]
02:36 <LocalisationUpdate> completed (1.24wmf22) at 2014-09-26 02:36:45+00:00 [production]
00:14 <awight> turning off Civi jobs before deployment [production]
2014-09-25 §
23:31 <maxsem> Synchronized php-1.25wmf1/skins/Vector/: https://gerrit.wikimedia.org/r/#/c/163021/ (duration: 00m 03s) [production]
23:15 <maxsem> Synchronized php-1.25wmf1/extensions/CentralAuth/: https://gerrit.wikimedia.org/r/#/c/162971/ (duration: 00m 04s) [production]
23:12 <maxsem> Synchronized php-1.25wmf1/includes/resourceloader/ResourceLoaderSiteModule.php: https://gerrit.wikimedia.org/r/#/c/163024/ (duration: 00m 03s) [production]
23:10 <maxsem> Synchronized php-1.25wmf1/includes/api/ApiQueryAllUsers.php: https://gerrit.wikimedia.org/r/#/c/163027/ (duration: 00m 03s) [production]
23:08 <maxsem> Synchronized php-1.24wmf22/includes/api/ApiQueryAllUsers.php: https://gerrit.wikimedia.org/r/#/c/163026/ (duration: 00m 03s) [production]
23:02 <maxsem> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/163048 (duration: 00m 03s) [production]
22:58 <ori> Synchronized php-1.24wmf22/extensions/Wikidata: Update Wikidata for I0acd2096d21b (duration: 00m 11s) [production]
21:41 <mutante> powercycling mw1053 [production]
20:37 <mutante> no !log [production]
20:36 <legoktm> manually migrated "NickK" to a global account [production]
20:29 <mutante> repooled mw1051 [production]
19:49 <bd808> Restarted logstash on logstash1001. udp2log events were not being recorded. [production]
19:30 <reedy> Synchronized php-1.25wmf1/: (no message) (duration: 00m 46s) [production]
19:24 <reedy> Synchronized php-1.24wmf22/resources/src/mediawiki.ui/components/buttons.less: (no message) (duration: 00m 14s) [production]
19:22 <bblack> ntp work done on hosts [production]
19:18 <reedy> Synchronized php-1.25wmf1/: (no message) (duration: 00m 55s) [production]
19:17 <reedy> Synchronized php-1.24wmf22/extensions/CentralAuth/: (no message) (duration: 00m 14s) [production]
18:55 <reedy> Synchronized wmf-config/: (no message) (duration: 00m 14s) [production]
18:47 <reedy> Synchronized wmf-config/: (no message) (duration: 00m 14s) [production]
18:20 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf1 [production]
18:08 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.24wmf22 [production]
17:21 <reedy> Finished scap: testwiki to 1.25wmf1 and build l10n cache (duration: 28m 36s) [production]
16:52 <reedy> Started scap: testwiki to 1.25wmf1 and build l10n cache [production]
16:41 <Reedy> Purged php-1.24wmf9 [production]
16:38 <reedy> Purged l10n cache for 1.24wmf20 [production]
15:32 <bblack> testing ntpd changes on acamar, achernar, chromium, hydrogen, nescio, and baham (puppet-agent disabled) [production]
15:19 <mattflaschen> Synchronized wmf-config/CommonSettings.php: Extend GettingStarted bucketting period end date to Sept. 28 (duration: 00m 07s) [production]
12:36 <godog> update bash on elastic1014 analytics1021 elastic1013 [production]
11:33 <_joe_> gracefully reloaded apache on mw1139 and mw1199, apc issues [production]
11:29 <aude> Synchronized php-1.24wmf22/extensions/Wikidata/extensions/Wikibase/lib/config/WikibaseLib.default.php: fix apc issues (duration: 00m 06s) [production]
11:03 <_joe_> updated bash on elastic1007 [production]
10:57 <godog> upgraded bash on labsdb1003 [production]