8851-8900 of 10000 results (38ms)
2015-07-19 §
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Jul 19 02:07:15 UTC 2015 (duration 7m 14s) [production]
02:03 <LocalisationUpdate> failed (1.26wmf14) at 2015-07-19 02:03:05+00:00 [production]
2015-07-18 §
20:58 <legoktm> Synchronized wmf-config/InitialiseSettings-labs.php: labs only (duration: 00m 12s) [production]
20:44 <YuviPanda> restarted etherpad [production]
18:56 <akosiaris> reinstall labsdb1004 [production]
16:36 <paravoid> Ganglia is up :) [production]
16:09 <Krenair> Ganglia seems down [production]
15:43 <Krenair> Doing T44180 [production]
05:28 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jul 18 05:28:25 UTC 2015 (duration 28m 24s) [production]
02:34 <LocalisationUpdate> completed (1.26wmf14) at 2015-07-18 02:34:29+00:00 [production]
02:30 <l10nupdate> Synchronized php-1.26wmf14/cache/l10n: (no message) (duration: 07m 19s) [production]
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jul 18 02:07:38 UTC 2015 (duration 7m 37s) [production]
02:03 <LocalisationUpdate> failed (1.26wmf14) at 2015-07-18 02:03:29+00:00 [production]
00:49 <ejegg> restored recurring globalcollect batch size of 250 [production]
00:09 <ejegg> updated civicrm from 78de1b9b74934984af3099afe9192fa53011bdaa to 292ad137f6b3ffc818a3bd617ca4f335931091f3 [production]
2015-07-17 §
21:51 <ejegg> updated civicrm from 0acac037ce0c9a64e94a475463deb2d47e84193a to 78de1b9b74934984af3099afe9192fa53011bdaa [production]
20:53 <matt_flaschen> Manually fixed issue in mediawikiwiki LQT thread table with rename of Ecliptica to Entropy. https://phabricator.wikimedia.org/T106122#1461380 [production]
20:03 <hashar> stopping Zuul to get rid of a faulty registered function "build:Global-Dev Dashboard Data". Job is gone already. [production]
17:50 <ejegg> updated civicrm from fa724dd2e2e69545d81015c943cb7f52cf6de8e1 to 0acac037ce0c9a64e94a475463deb2d47e84193a [production]
16:49 <gwicke> restarted restbase on restbase1001 [production]
15:04 <gwicke> restarted RB thinner scripts, see https://phabricator.wikimedia.org/T105706 [production]
14:10 <urandom> restart restbase service on restbase1006 [production]
14:07 <urandom> restart restbase service on restbase1003 [production]
14:05 <urandom> restart restbase service on restbase1002 [production]
13:56 <godog> apache2ctl graceful on fluorine antimony argon caesium helium [production]
13:43 <godog> apache2ctl graceful on netmon1001 [production]
11:24 <hashar> rebooted labnodepool1001.eqiad.wmnet . Accidentally deleted the whole /dev which freeze everything :( [production]
10:21 <_joe_> repooling mw1158 [production]
09:08 <_joe_> depooling mw1158, repooling mw1156,7 [production]
07:51 <_joe_> depooled mw1156,7 for reimaging [production]
04:54 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Jul 17 04:53:56 UTC 2015 (duration 53m 55s) [production]
03:31 <springle> Synchronized wmf-config/db-eqiad.php: repool db1030 (duration: 00m 12s) [production]
02:30 <LocalisationUpdate> completed (1.26wmf14) at 2015-07-17 02:30:03+00:00 [production]
02:26 <l10nupdate> Synchronized php-1.26wmf14/cache/l10n: (no message) (duration: 05m 55s) [production]
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Jul 17 02:07:22 UTC 2015 (duration 7m 20s) [production]
02:03 <LocalisationUpdate> failed (1.26wmf14) at 2015-07-17 02:03:12+00:00 [production]
01:30 <mutante> git pull origin on strontium [production]
2015-07-16 §
21:27 <ori> bounced nutcracker on mw1139 as well. hashar noticed flood of errors from these hosts on https://logstash.wikimedia.org/#/dashboard/elasticsearch/mediawiki-errors . lack of monitoring / alerts is troubling. [production]
21:26 <ori> bounced nutcracker on mw1128 and mw1134 [production]
20:50 <mutante> iegreview tool - short maintenance downtime [production]
19:39 <YuviPanda> imported aspell-id from ubuntu to jessie-wikimedia - needed by ores, simple package that I am not sure why it is not in jessie [production]
19:20 <twentyafterfour> Synchronized php-1.26wmf14/includes/db/LoadMonitor.php: Deploying Hotfix for T105373 (duration: 00m 13s) [production]
18:40 <twentyafterfour> rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf14 [production]
18:26 <ejegg> changed batch size from 250 to 1 in RGC jenkins job [production]
18:22 <ejegg> updated civicrm from 24e0fc854433ea4982e94a0fd2f8bdad8f8dcad7 to fa724dd2e2e69545d81015c943cb7f52cf6de8e1 [production]
16:56 <Jeff_Green> authdns update to rename lutetium.wm.o [production]
16:08 <hashar_> kept nodepool stopped on labnodepool1001.eqiad.wmnet because it spams the cron log [production]
15:57 <demon> Synchronized multiversion/MWMultiVersion.php: prod no-op, beta change (duration: 00m 13s) [production]
15:54 <krenair> Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/224975/ (duration: 00m 12s) [production]
15:27 <thcipriani> Synchronized php-1.26wmf14/extensions/Math/MathMathML.php: SWAT: Fix: Undefined variable passed hook [[gerrit:225058]] (duration: 00m 12s) [production]