751-800 of 10000 results (32ms)
2016-07-01 §
11:23 <godog> bounce statsdlb on graphite1001, drops are back after yesterday's reboot T101141 [production]
11:15 <moritzm> removed two obsolete, older kernel packages from wtp1002 (had flagged an icinga warning on diskspace on /boot) [production]
09:38 <elukey> rebooted eventlog2001.codfw.wmnet for kernel upgrades [production]
09:35 <moritzm> rolling reboot of swift backends in codfw [production]
09:15 <moritzm> powercycling ms-fe2003, stuck after reboot [production]
09:03 <moritzm> powercycling ms-fe2002, stuck after reboot [production]
08:41 <moritzm> powercycling ms-fe2001, stuck after reboot [production]
08:32 <moritzm> rolling reboot of swift frontends in codfw [production]
06:28 <moritzm> resuming rolling reboots of elastic* clusters in eqiad and codfw [production]
06:18 <moritzm> rolling reboot of wtp1* for kernel security update [production]
02:44 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Jul 1 02:44:01 UTC 2016 (duration 5m 7s) [production]
02:38 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.8) (duration: 17m 02s) [production]
01:59 <ori@tin> Synchronized wmf-config/CommonSettings.php: I3a8057a8: Bump $wgResourceLoaderMaxQueryLength to 3,000 (duration: 00m 28s) [production]
01:46 <aaron@tin> Synchronized wmf-config/InitialiseSettings.php: Enable LocalFile log (duration: 00m 32s) [production]
01:08 <ori@tin> Synchronized wmf-config/InitialiseSettings.php: Ie8a71af5: HD logo for en.wiktionary (2/2) (duration: 00m 27s) [production]
01:07 <ori@tin> Synchronized static/images/project-logos: Ie8a71af5: HD logo for en.wiktionary (1/2) (duration: 00m 28s) [production]
01:04 <ori@tin> Synchronized php-1.28.0-wmf.8/extensions/WikimediaEvents/modules/ext.wikimediaEvents.deprecate.js: Ie28d823c: Log ResourceLoader URL-splitting (duration: 00m 32s) [production]
00:20 <maxsem@tin> Finished scap: https://gerrit.wikimedia.org/r/#/c/296819/ - noop in prod (duration: 27m 27s) [production]
2016-06-30 §
23:53 <maxsem@tin> Started scap: https://gerrit.wikimedia.org/r/#/c/296819/ - noop in prod [production]
23:47 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/296257/ (duration: 00m 26s) [production]
23:43 <maxsem@tin> Synchronized portals: (no message) (duration: 00m 27s) [production]
23:43 <maxsem@tin> Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 28s) [production]
23:41 <ori> banned /static/images/project-logos/enwiktionary.png and /static/images/project-logos/adywiki.png [production]
23:37 <maxsem@tin> Synchronized docroot/mediawiki/xml/sitelist-1.0/index.html: https://gerrit.wikimedia.org/r/#/c/296788/ (duration: 00m 24s) [production]
23:27 <maxsem@tin> Synchronized static/images/project-logos/: (no message) (duration: 00m 27s) [production]
23:12 <maxsem@tin> Synchronized static/images/project-logos/enwiktionary.png: https://gerrit.wikimedia.org/r/#/c/296757/ (duration: 00m 30s) [production]
22:04 <krinkle@tin> Synchronized wmf-config/InitialiseSettings.php: test2wiki wgSquidMaxage (duration: 00m 28s) [production]
21:00 <ebernhardson> change cluster.routing.allocation.disk.watermark.high on eqiad elasticsearch cluster to 80% [production]
20:52 <aaron@tin> Synchronized php-1.28.0-wmf.8/includes/filerepo/file/LocalFile.php: 51d7fb48f2af31d69db115a8b3ed790cdaaf0d2e (duration: 00m 35s) [production]
19:47 <aaron@tin> Synchronized wmf-config/InitialiseSettings.php: Set the SaveParse log (duration: 00m 26s) [production]
19:43 <twentyafterfour> ran scap pull on mw2123 [production]
19:42 <twentyafterfour> ran scap pull on mw2098 [production]
19:42 <gehel> activating statement timeout limitations for kartotherian on maps cluster codfw (T138422) [production]
19:38 <ostriches> mw2134: running sync-common, seems out of...sync :) [production]
19:20 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: (no message) [production]
19:19 <twentyafterfour> Deploying 1.28.0-wmf.8 to all wikimedia wikis. [production]
19:18 <aaron@tin> Synchronized php-1.28.0-wmf.8/includes: adc4c90202d6c44aa58756e3c6bc35918afc5f75 (duration: 01m 19s) [production]
18:24 <ori> restarted coal on graphite1001 and navtiming on hafnium due to inexplicably stopped metrics; nothing useful in logs. [production]
17:48 <yurik> deployed Kartotherian https://gerrit.wikimedia.org/r/#/c/296787/ [production]
17:10 <yurik> deployed Graphoid https://gerrit.wikimedia.org/r/#/c/296780/ [production]
17:07 <jynus> stopping slave on db1073 to test InnoDB compression T139055 [production]
16:44 <dcausse> restarting elastic1036 (master in eqiad) [production]
16:23 <thcipriani@tin> Synchronized wmf-config: SWAT:Revert "Use extension registration for TitleBlacklist" (duration: 00m 32s) [production]
16:22 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT:Revert "Use extension registration for TitleBlacklist" (duration: 00m 27s) [production]
16:17 <dcausse> truncating elastic logs on elastic1036 and elastic1021 [production]
16:16 <thcipriani@tin> Synchronized wmf-config: SWAT: [[gerrit:281240|Use extension registration for TitleBlacklist (T119117)]] PART II (duration: 00m 36s) [production]
16:15 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:281240|Use extension registration for TitleBlacklist (T119117)]] PART I (duration: 00m 39s) [production]
15:53 <thcipriani@tin> Synchronized wmf-config: SWAT: [[gerrit:281237|Use extension registration for LabeledSectionTransclusion (T119117)]] (duration: 00m 27s) [production]
15:48 <thcipriani@tin> Synchronized wmf-config: SWAT: [[gerrit:296419|Short array syntax]] (duration: 00m 30s) [production]
15:39 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: SWAT: [[gerrit:296744|Put wikidatawiki back on 1.28.0-wmf.8]] [production]