1601-1650 of 10000 results (42ms)
2017-06-17 §
02:23 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.5) (duration: 07m 09s) [production]
2017-06-16 §
19:54 <Reedy> disabled cluster 2fa for Chrissymad for T168064 (confirmed by email) [production]
19:26 <ejegg> re-enabled paypal audit download and parse job [production]
19:13 <ebernhardson> restarting elasticesarch on relforge to pick up new ltr-query plugin version [production]
18:14 <mutante> ms-be1001: did not change config, tried again, now detected 13 drives again, coming back [production]
18:10 <mutante> ms-be1001 - The following VDs are missing: 09 [production]
18:08 <mutante> ms-be1001 - powercycling crashed server - "[14076481.245487] general protection fault: 0000 [#4] SMP [production]
13:36 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove comments from db1018 current status - T166205 (duration: 00m 41s) [production]
13:26 <twentyafterfour> fixed phabricator "upgrade database" error. [production]
13:20 <twentyafterfour> fixing phab database migrations [production]
13:01 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1091 after performance testing (duration: 00m 41s) [production]
10:18 <jynus> running analyze on db1091 (depooled), may create lag [production]
10:11 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1091 for performance testing (duration: 00m 42s) [production]
09:52 <moritzm> installing guile security updates [production]
09:13 <moritzm> re-enabled puppet on mw2129 (no reason was given why it was disabled( [production]
08:50 <jynus> bringing down pc1005 and pc1006 for maintenance T167567 [production]
08:40 <jynus@tin> Synchronized wmf-config/db-codfw.php: Add db1099 and db1001 hosts to config (duration: 00m 41s) [production]
08:23 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Switchover pc1005 and pc1006 to db1099 and db1001 (duration: 00m 45s) [production]
08:20 <jynus> about to swithover pc1005 and pc1006 to db1099 and db1001 [production]
05:45 <ebernhardson> increase enwiki_content replicas on codfw from 2 to 3 to match eqiad [production]
02:37 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Jun 16 02:37:05 UTC 2017 (duration 6m 25s) [production]
02:30 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.5) (duration: 07m 02s) [production]
2017-06-15 §
23:37 <mutante> added stretch support for jenkins (https://gerrit.wikimedia.org/r/#/c/359227/, https://gerrit.wikimedia.org/r/#/c/359356/) | 'reprepro copy stretch-wikimedia jessie-wikimedia jenkins' to make .deb available on stretch | releases1001 now running jenkins , icinga recovered | (hashar) (T164030) [production]
23:30 <mutante> APT - reprepro copy strech-wikimedia jessie-wikimedia jenkins (copy existing jenkins package to stretch, it can be used on both) [production]
23:18 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: T166408: Remove dead config variable MinervaPrintStyles (duration: 00m 41s) [production]
23:15 <ebernhardson@tin> Finished scap: wmf-config Scap: T162276: Enable crossproject search (duration: 03m 37s) [production]
23:11 <ebernhardson@tin> Started scap: wmf-config Scap: T162276: Enable crossproject search [production]
23:10 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: Scap: T162276: Enable crossproject search (duration: 00m 51s) [production]
22:59 <mutante> mw2251 - repooled [production]
22:56 <mutante> mw2251 - scap pull [production]
22:53 <ebernhardson> restarting elasticsearch on relforge to pickup new ltr-query plugin [production]
22:30 <ejegg> updated DjangoBannerStats from 9e6b11712851919e4318930e19bdf9c941d8ae38 to 5963e7c116f083ada28476c1c41ff1b46232d772 [production]
22:02 <volans> restarted pdfrender on scb1001 T159922 [production]
21:45 <mutante> powercycling mw2251 (frozen console) [production]
21:39 <volans@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw2251.codfw.wmnet [production]
21:37 <volans> re-enabled puppet and force run to re-enable ircecho on einstenium [production]
21:29 <demon@tin> Finished scap: Removing Cards extension (duration: 21m 49s) [production]
21:08 <demon@tin> Started scap: Removing Cards extension [production]
20:57 <mutante> upgrading RT (request tracker) [production]
19:35 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: group2 to wmf.5 [production]
19:22 <ladsgroup@tin> Finished deploy [ores/deploy@ab88a74]: Deploying gerrit:359224/1 for missing config variables (duration: 24m 15s) [production]
19:17 <XioNoX> Re-enabled link between cr2-codfw and cr1-eqdfw - T167261 [production]
18:58 <ladsgroup@tin> Started deploy [ores/deploy@ab88a74]: Deploying gerrit:359224/1 for missing config variables [production]
18:44 <paravoid> restarting all puppetmasters [production]
18:40 <paravoid> temporarily stopping icinga-wm [production]
18:27 <demon@tin> Synchronized wmf-config/CirrusSearch-common.php: Remove quirks and enable token_count_router thingie (duration: 00m 44s) [production]
18:16 <demon@tin> Synchronized php-1.30.0-wmf.5/includes/libs/objectcache/MultiWriteBagOStuff.php: T167465 (duration: 00m 44s) [production]
18:14 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: T167617 (duration: 00m 44s) [production]
18:12 <demon@tin> Synchronized wmf-config/FeaturedFeedsWMF.php: T167617 (duration: 00m 44s) [production]
17:50 <mutante> install2002 - re-enabled puppet, reverted live hack, back to normal (issue seems to be NIC or other) [production]