5351-5400 of 10000 results (36ms)
2015-11-06 §
13:36 <bblack> cp4007 repooled - T117746 [production]
13:16 <bblack> upgrading pybal 1.10 -> 1.12 on lvs300[34].esams.wmnet [production]
13:11 <bblack> re-enabled aws-d-eqiad in librenms [production]
13:09 <bblack> upgrading pybal 1.10 -> 1.12 on lvs4003 [production]
12:18 <mark> Swapped cr2-knams fpc 1 mic 1 for a new 2x 10G line card [production]
12:18 <mark> Swapped cr2-knams fpc 1 mic 1 for a new 2x 10 [production]
12:18 <mark> mark@cr2-knams> request chassis mic fpc-slot 1 mic-slot 1 online [production]
12:10 <mark> mark@cr2-knams> request chassis mic fpc-slot 1 mic-slot 1 offline [production]
11:31 <jynus> stopping mysql and cloning db2042 -> db2070, db2054 -> db2068, db2053 -> db2067, db2049 -> db2056 [production]
11:12 <jynus@tin> Synchronized wmf-config/db-codfw.php: Depool db2042, db2049, db2053 and db2054 for cloning (duration: 00m 34s) [production]
09:09 <jynus> Stopping mysql and cloning db2044 -> db2065, db2048 -> db2069, db2045 -> db2066 [production]
08:55 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db20 34,42,35,38,39,40. New: 58,64,60,61,62,59. Depool: 44,45,48 (duration: 01m 10s) [production]
02:28 <l10nupdate@tin> Synchronized php-1.27.0-wmf.5/cache/l10n: l10nupdate for 1.27.0-wmf.5 (duration: 05m 56s) [production]
01:42 <krenair@mira> Synchronized README: done (duration: 00m 34s) [production]
01:38 <krenair@mira> Synchronized README: test (duration: 00m 34s) [production]
01:32 <bd808@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/251446/ (duration: 00m 35s) [production]
01:29 <bd808@tin> Synchronized wmf-config/logging.php: https://gerrit.wikimedia.org/r/#/c/249313/ (forgot to apply after fetching) (duration: 00m 34s) [production]
01:28 <bd808@tin> Synchronized wmf-config/InitialiseSettings.php: Touch (duration: 00m 35s) [production]
01:26 <bd808@tin> Synchronized wmf-config/logging.php: https://gerrit.wikimedia.org/r/#/c/249313/ (duration: 00m 34s) [production]
01:10 <krenair@tin> Synchronized multiversion/defines.php: https://gerrit.wikimedia.org/r/#/c/251447/ (duration: 00m 34s) [production]
01:00 <krenair@tin> Synchronized php-1.27.0-wmf.5/resources/src/mediawiki/mediawiki.ForeignStructuredUpload.BookletLayout.js: https://gerrit.wikimedia.org/r/#/c/251307/ (duration: 00m 34s) [production]
00:59 <krenair@tin> Synchronized php-1.27.0-wmf.5/resources/src/mediawiki/mediawiki.ForeignStructuredUpload.js: https://gerrit.wikimedia.org/r/#/c/251301/ https://gerrit.wikimedia.org/r/#/c/251306/ and https://gerrit.wikimedia.org/r/#/c/251307/ (duration: 00m 35s) [production]
00:34 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/251317/ (duration: 00m 35s) [production]
00:18 <krenair@tin> Synchronized php-1.27.0-wmf.5/extensions/Flow: https://gerrit.wikimedia.org/r/#/c/251416/ (duration: 00m 37s) [production]
2015-11-05 §
23:34 <bd808> Decreased replica count of logstash-2015.10.13 and logstash-2015.10.14 to free disk space on cluster [production]
23:30 <bd808> Logging volume into ELK cluster down dramatically; investigating [production]
23:16 <ori@tin> Synchronized wmf-config/logging.php: Ieb8c602a: monolog: Ensure that context data added by WebProcessor is utf-8 safe (duration: 00m 36s) [production]
22:35 <ori@tin> Synchronized php-1.27.0-wmf.5/extensions/WikimediaEvents: Ic99ac31f740956: Log backend response time on edit requests (duration: 00m 35s) [production]
21:54 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: sync 1.27.0-wmf.5 to group2 [production]
20:17 <demon@tin> Finished scap: no changes, testing permissions on mira co-master (duration: 07m 29s) [production]
20:10 <demon@tin> Started scap: no changes, testing permissions on mira co-master [production]
20:07 <_joe_> chown mwdeploy:wikidev recursively on mira for /srv/mediawiki-staging [production]
19:37 <twentyafterfour@tin> Finished scap: Sync everything just to be sure (duration: 22m 01s) [production]
19:15 <twentyafterfour@tin> Started scap: Sync everything just to be sure [production]
18:58 <demon@tin> Synchronized README: no-op, testing new scap code (duration: 00m 19s) [production]
18:52 <ostriches> scap: deploying master@b44c268 [production]
18:05 <jynus> schema change on x1 - flowdb [production]
17:46 <ostriches> 17:45:13 Synchronized wmf-config/: Remove +superprotect, I579c11a2 (duration: 00m 18s) [production]
17:44 <jynus> Deploying schema change on officewiki - flow (s3) [production]
17:11 <godog> nodetool decommission on praseodymium [production]
14:12 <jynus> reinstalling db2056.codfw.wmnet [production]
13:57 <jynus> shuting down mysql and cloning db2042 -> db2062, db2038 -> db2059, db2039 -> db2060, db2040 -> db2061 [production]
13:43 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2051; Depool db2042, 38, 39, 40 for cloning (duration: 00m 18s) [production]
12:33 <_joe_> manually disabling mod_cgi on terbium [production]
09:56 <godog> run removenode on cerium.eqiad.wmnet -- decomission was missed before reimaging [production]
09:33 <jynus> stopping mysql and cloning db2034 -> db2062, db2035 -> db2063, db2051 -> db2058 [production]
09:25 <jynus@tin> Synchronized wmf-config/db-codfw.php: Pool db2048, db2049, db2050,db2055, db2057, db2063. Depool db2034, db2035, db2051 (duration: 00m 17s) [production]
08:05 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Nov 5 08:05:13 UTC 2015 (duration 5m 12s) [production]
03:21 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.5) at 2015-11-05 03:21:45+00:00 [production]
03:15 <l10nupdate@tin> Synchronized php-1.27.0-wmf.5/cache/l10n: l10nupdate for 1.27.0-wmf.5 (duration: 10m 17s) [production]