6401-6450 of 10000 results (54ms)
2016-09-20 §
00:43 <mutante> wtp2019 - down again, powercycled, probably damaged RAM [production]
2016-09-19 §
23:22 <Pchelolo> restart restbase in staging [production]
23:01 <awight> update orphan rectifier config for T145848 [production]
22:58 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: Restore testwiki to 1.28.0-wmf.18 [production]
22:53 <dapatrick> Deployed patch for T144573 to wmf18 and wmf19 [production]
22:48 <thcipriani@tin> Finished scap: testwiki to php-1.28.0-wmf.19 and rebuild l10n cache (duration: 52m 03s) [production]
22:31 <bblack> cache_upload: pooling cp1099 (storage experiment - T145661) [production]
22:02 <awight> update paymentswiki from 4cd18776ca67fe0db04b4173cb47f39dda59f43b to d572ee9e3ef0a97c044f02e9866469a8f3fa5858 [production]
22:00 <bblack> cp1099: depooling varnish backends for storage size experimentation [production]
21:56 <thcipriani@tin> Started scap: testwiki to php-1.28.0-wmf.19 and rebuild l10n cache [production]
21:41 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: Revert group0 wikis to 1.28.0-wmf.19 [production]
21:30 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 wikis to 1.28.0-wmf.19 [production]
20:40 <hoo> Removed today's Wikidata json dumps: All shards succeeded, but final dump composition apparently failed. [production]
20:14 <chasemp> reboot labstore1004 [production]
20:08 <Pchelolo> restbase deploy 4829630f staging [production]
18:49 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:311417|Throttle for RCL (T145838)]] (duration: 00m 47s) [production]
18:43 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:311229|ORES default threshold to high for wikidatawiki (T144784)]] (duration: 00m 47s) [production]
18:32 <jynus> emergency/unscheduled restart of mariadb @ labsdb1003 - close to OOM, unusable [production]
18:14 <thcipriani> ran on terbium: mwscript extensions/ShortUrl/populateShortUrlTable.php --wiki=bdwikimedia [production]
17:47 <awight> reenable banner history queue consumer [production]
17:46 <awight> update civicrm from 1df25962834885121bd7a9ba856c0c69c2b9cfda to c9157ba6aac3ad3c2fd61c7bb0475851fb8ec421 [production]
17:39 <ejegg> updated payments-wiki from 392d67520d14998d61823755b22df50ab45afb35 to 4cd18776ca67fe0db04b4173cb47f39dda59f43b [production]
17:36 <Krenair> Reset wikitech/horizon 2fa for Greg per request [production]
15:50 <akosiaris> T107306 uploaded to apt.wikimedia.org jessie-wikimedia: apertium-nno-nob_1.1.0~r66076-1+wmf1 [production]
15:50 <akosiaris> T107306 uploaded to apt.wikimedia.org jessie-wikimedia: apertium-br-fr_0.5.0~r61325-1+wmf1 [production]
14:40 <chasemp> testing nfs export performance on labstore1004/1005 cluster [production]
14:35 <yurik> depl graphoid https://gerrit.wikimedia.org/r/#/c/311374/ [production]
14:28 <moritzm> uploaded apache 2.4.10-10+deb8u7+wmf1 for jessie-wikimedia to carbon [production]
14:21 <elukey> adding aqs1004 to live traffic - aqs.svc.eqiad.wmnet - T144497 [production]
14:10 <moritzm> reimaging mw1246-mw1248 to jessie [production]
14:10 <hashar> European SWAT is complete. [production]
14:05 <zeljkof> EU SWAT finished [production]
14:05 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:311327|Add WT namespace alias to NS_PROJECT in mywiktionary (T140998)]] (duration: 00m 47s) [production]
14:01 <hashar@tin> Synchronized php-1.28.0-wmf.19/extensions/Graph: Fixed wikiraw: protocol bug T146010 (duration: 00m 47s) [production]
14:00 <hashar@tin> Synchronized php-1.28.0-wmf.18/extensions/Graph: Fixed wikiraw: protocol bug T146010 (duration: 00m 48s) [production]
13:58 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:309823|Enable WikidataPageBanner on itwikiwoyage (T145328)]] (duration: 00m 48s) [production]
13:55 <hashar> Europe SWAT extended as we still have some patches to process [production]
13:47 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:311086|Throttling rule for RCL (T145838)]] [[gerrit:311087|[throttle] Allow the same number accounts]] [[gerrit:311088|Throttle for RCL]] (duration: 00m 47s) [production]
13:18 <hashar@tin> Synchronized php-1.28.0-wmf.19/includes/api/ApiQueryBacklinksprop.php: API: Force straight join for prop=linkshere|transcludedin|fileusage T145079 (duration: 00m 47s) [production]
13:18 <hashar@tin> Synchronized php-1.28.0-wmf.18/includes/api/ApiQueryBacklinksprop.php: API: Force straight join for prop=linkshere|transcludedin|fileusage T145079 (duration: 00m 50s) [production]
12:59 <moritzm> installing wget updates from jessie 8.6 point update [production]
12:51 <elukey> adding mw1191 back to serving traffic after reimage [production]
11:43 <mobrovac> restbase cassandra truncating local_group_wikipedia_T_feed_aggregated.data [production]
11:32 <jynus> rebooting again db1061 for upgrade [production]
11:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Temporarily depool db1062 and repool db1034, in order to be able to ALTER a large table. T141951 (duration: 00m 48s) [production]
10:49 <moritzm> reimaging mw1249, mw1250, mw1258 to jessie [production]
10:23 <jynus> powercycle db1061, unresponsive since ~1am [production]
09:20 <moritzm> invalidated squid cache on carbon [production]
08:49 <akosiaris> increase /var/lib/puppet to 50GB on puppetmaster1002, puppetmaster2001, puppetmaster2002 [production]
08:48 <addshore@tin> Synchronized wmf-config/CommonSettings.php: {{gerrit|311118}} NOOP Some inline comments added (duration: 00m 58s) [production]