3501-3550 of 10000 results (32ms)
2015-09-16 ยง
17:34 <paravoid> asw-d-eqiad: toggling RE mastership again [production]
17:26 <godog> stop puppet on restbase* to apply https://gerrit.wikimedia.org/r/#/c/238738/ / merge / reenable puppet [production]
16:54 <_joe_> turned on the hhvm tmh, stopping the zend ones for testing [production]
16:44 <oblivian@tin> Synchronized wmf-config/CommonSettings.php: use ffmpeg whereever possible (duration: 00m 12s) [production]
16:16 <bblack> upgrading pybal on lvs400[12] [production]
16:12 <bblack> upgrading pybal on lvs400[34], lvs300[34] [production]
16:08 <bblack> upgrading pybal on lvs200[123] [production]
16:05 <bblack> upgrading pybal on lvs200[456] [production]
15:44 <_joe_> uploading pybal 1.10 to reprepro, installing to the test cluster [production]
15:24 <moritzm> uploaded debdeploy 0.0.6 to apt.wikimedia.org [production]
15:10 <hashar> Started using Nodepool spawned instances. Moved integration-jjb-config-diff Jenkins job to Nodepool with https://gerrit.wikimedia.org/r/#/c/238752/ . See also: https://phabricator.wikimedia.org/T112750 [production]
15:05 <demon@tin> Synchronized wmf-config/CommonSettings.php: Add m.wikidata.org to wgCrossSiteAJAXdomains (duration: 00m 12s) [production]
14:51 <_joe_> experimenting on testwiki for poolcounter failure scenarios [production]
14:45 <moritzm> enabled ferm on mw1010 (jobrunner) in eqiad [production]
14:27 <paravoid> asw-d-eqiad: toggling RE mastership [production]
14:18 <paravoid> disabling/ignoring asw-d-eqiad @ librenms [production]
14:09 <jynus> upgrading and restarting db1051 [production]
13:57 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool es1051 for maintenance (duration: 00m 12s) [production]
13:40 <urandom> initiating Cassandra repair on restbase1007 (nodetool repair -pr) [production]
13:40 <catrope@tin> Synchronized php-1.26wmf23: (no message) (duration: 01m 37s) [production]
13:35 <moritzm> repooled mw1149-mw1151 (with ferm enabled) [production]
13:24 <moritzm> depooled mw1149-mw1151 (for enabling ferm) [production]
13:19 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Reverting depool of es1055 (duration: 00m 12s) [production]
13:15 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool es1055 for maintenance (duration: 00m 12s) [production]
13:03 <paravoid> disabling asw-d-eqiad xe-8/0/23, xe-8/0/24, xe-8/0/25, xe-8/0/26, xe-8/0/27, xe-8/0/28; servers reboot-looping -> asw-d's SNMP unhappy -> librenms unhappy -> faidon's mailbox unhappy [production]
12:48 <moritzm> repooled mw1115-mw1117, mw1119 (with ferm enabled) [production]
12:42 <moritzm> depooling mw1115-mw1117, mw1119 (mw1118 was already depooled) to enable ferm [production]
11:32 <moritzm> repooled mw1019-mw1025 with ferm enabled [production]
11:24 <jynus> making db1069 a sibling of db1055 (s1) [production]
11:13 <godog> create restbase user on cassandra test cluster [production]
11:07 <moritzm> depooled mw1019-mw1025 (to enable ferm) [production]
10:52 <catrope@tin> Synchronized php-1.26wmf23: (no message) (duration: 02m 04s) [production]
10:49 <catrope@tin> Synchronized php-1.26wmf22: (no message) (duration: 02m 12s) [production]
10:48 <jynus> reenabling semisync on db1072 and db1073 [production]
10:47 <catrope@tin> scap aborted: (no message) (duration: 00m 21s) [production]
10:47 <catrope@tin> Started scap: (no message) [production]
10:24 <catrope@tin> Synchronized php-1.26wmf23/includes/changes/EnhancedChangesList.php: T112738 (duration: 00m 12s) [production]
10:08 <aude@tin> Synchronized arbitraryaccess.dblist: (no message) (duration: 00m 11s) [production]
08:12 <moritzm> repooled mw1153 with ferm enabled [production]
07:57 <jynus> truncated some tables from ContentTranslation extension on x1 [production]
07:57 <moritzm> depooled mw1153 (it's an image scaler, of course) to enable ferm [production]
07:56 <moritzm> depooled mw1153 (videoscaler) to enable ferm [production]
06:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Sep 16 06:31:58 UTC 2015 (duration 31m 57s) [production]
03:28 <ori@tin> Synchronized php-1.26wmf22/vendor/monolog/monolog/src/Monolog/Logger.php: Iccfda47689: monolog: Don't waste milliseconds counting microseconds (duration: 00m 12s) [production]
03:27 <ori@tin> Synchronized php-1.26wmf23/vendor/monolog/monolog/src/Monolog/Logger.php: Iccfda47689: monolog: Dont waste milliseconds counting microseconds ; sync-file php-1.26wmf22/vendor/monolog/monolog/src/Monolog/Logger.php Iccfda47689: monolog: Dont waste milliseconds counting microseconds (duration: 00m 12s) [production]
03:12 <l10nupdate@tin> LocalisationUpdate completed (1.26wmf23) at 2015-09-16 03:12:08+00:00 [production]
03:05 <l10nupdate@tin> Synchronized php-1.26wmf23/cache/l10n: l10nupdate for 1.26wmf23 (duration: 10m 30s) [production]
02:38 <l10nupdate@tin> LocalisationUpdate completed (1.26wmf22) at 2015-09-16 02:38:48+00:00 [production]
02:35 <l10nupdate@tin> Synchronized php-1.26wmf22/cache/l10n: l10nupdate for 1.26wmf22 (duration: 07m 02s) [production]
01:03 <krinkle@tin> Synchronized php-1.26wmf23/resources/src/mediawiki/mediawiki.js: hotfix Ia2fcd13f4 (duration: 00m 12s) [production]