4451-4500 of 10000 results (41ms)
2015-11-02 §
09:39 <_joe_> moved tor exit node, update_special_pages off of terbium to mw1152 [production]
09:24 <mobrovac> citoid restarted zotero on sca100x [production]
09:07 <jynus> deleting user_daily_contribs view on labs (it points to a non-existent table) [production]
08:57 <mobrovac> restbase deploying 8036232 [production]
05:33 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Nov 2 05:33:07 UTC 2015 (duration 33m 6s) [production]
02:25 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.4) at 2015-11-02 02:25:42+00:00 [production]
02:22 <l10nupdate@tin> Synchronized php-1.27.0-wmf.4/cache/l10n: l10nupdate for 1.27.0-wmf.4 (duration: 06m 44s) [production]
2015-11-01 §
16:59 <gwicke> restarting cassandra on aqs1002; was out of heap space [production]
05:25 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Nov 1 05:25:49 UTC 2015 (duration 25m 48s) [production]
02:24 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.4) at 2015-11-01 02:24:46+00:00 [production]
02:21 <l10nupdate@tin> Synchronized php-1.27.0-wmf.4/cache/l10n: l10nupdate for 1.27.0-wmf.4 (duration: 06m 36s) [production]
2015-10-31 §
08:57 <dcausse> elastic1008 deleting /var/log/elasticsearch/production-search-eqiad_index_indexing_slowlog.log.[2-7] [production]
05:15 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Oct 31 05:15:43 UTC 2015 (duration 15m 42s) [production]
02:54 <ori@tin> Synchronized php-1.27.0-wmf.4/vendor/monolog/monolog/src/Monolog/Logger.php: Iccfda4768 (duration: 00m 19s) [production]
02:26 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.4) at 2015-10-31 02:26:22+00:00 [production]
02:23 <l10nupdate@tin> Synchronized php-1.27.0-wmf.4/cache/l10n: l10nupdate for 1.27.0-wmf.4 (duration: 06m 26s) [production]
2015-10-30 §
23:53 <ori@tin> Synchronized wmf-config/CommonSettings.php: Ifd3543d99: Re-enabled sidebar cache per 47eb083a0fe4 (duration: 00m 17s) [production]
23:38 <ori@tin> Synchronized php-1.27.0-wmf.4/includes/cache/MessageCache.php: Id9a27ba2bbd3 (duration: 00m 17s) [production]
23:38 <ori@tin> Synchronized php-1.27.0-wmf.4/includes/skins/Skin.php: Id9a27ba2bbd3 (duration: 00m 17s) [production]
23:37 <ori@tin> Synchronized php-1.27.0-wmf.4/extensions/Collection: b89cff0a1d: Updated mediawiki/core Project: mediawiki/extensions/Collection 092204bf333e65b2c749e4bc4a32fd2b0254089b (duration: 00m 18s) [production]
23:37 <ori@tin> Synchronized php-1.27.0-wmf.4/extensions/DismissableSiteNotice: a20aa8a544: Updated mediawiki/core Project: mediawiki/extensions/DismissableSiteNotice 5b8f1cfac48704fd740eb61f873aabb600c4c5fb (duration: 00m 17s) [production]
23:03 <gwicke> fixed restbase labs install by deploying it; the code had gone missing [production]
23:03 <ori> Added MaxSem and gwicke to Gerrit Project Creators group [production]
22:44 <ori@tin> Synchronized php-1.27.0-wmf.4/includes/objectcache/ObjectCache.php: If12aedae7f: objectcache: Use singleton cache in newAccelerator() (duration: 00m 18s) [production]
22:05 <ori@tin> Synchronized docroot and w: (no message) (duration: 00m 17s) [production]
22:01 <mutante> labvirt1010: salt-minion always in "stop/waiting", doesn't restart [production]
21:54 <mutante> labvirt1010 - start salt [production]
21:41 <ori> Removing MediaWiki.xhprof.* from graphite{1,2}001 [production]
21:41 <ori@tin> Synchronized wmf-config/StartProfiler.php: I0bfa21b5: Disable xhprof profiling to relieve storage pressure on graphite (duration: 00m 18s) [production]
18:56 <jynus> disabling puppet and restarting mysql on es2008, es2009 and es2010- downtime planned for 2 hours - no production impact [production]
17:33 <robh> bismuth has no console output, appears locked up in OS, rebooting via mgmt [production]
17:22 <ori@tin> Synchronized docroot and w: (no message) (duration: 00m 18s) [production]
16:56 <cmjohnson> reinstalling mw1083 https://phabricator.wikimedia.org/T116184 [production]
15:35 <moritzm> updated db205[6-8] to the 3.19 kernel [production]
14:38 <chasemp> nobelium in downtime -- this is a temporary test host for discovery and is not ops actionable [production]
13:47 <Krenair> revert commit for https://gerrit.wikimedia.org/r/#/c/249971/ on tin [production]
13:47 <krenair@tin> Synchronized php-1.27.0-wmf.4/extensions/VisualEditor/VisualEditor.hooks.php: https://gerrit.wikimedia.org/r/#/c/249999/ (duration: 00m 17s) [production]
11:57 <paravoid> upgrading tor to latest stable on radium [production]
11:31 <paravoid> ignoring asw-d-eqiad on librenms [production]
11:25 <_joe_> powercycling dataset1001, stuck in some kernel task, unable to login from console [production]
10:42 <dcausse> elastic in eqiad setting indexing trace threshold to -1 for commons, ruwiki, frwiki and itwiki [production]
10:30 <dcausse> elastic in eqiad wide settings for indexing slow threshold are ineffective, trying to set index settings (T117181) [production]
09:18 <dcausse> elastic in eqiad setting index.indexing.slowlog.threshold.index.trace to -1 [production]
08:46 <_joe_> removed production-search-eqiad_index_indexing_slowlog.log.{7,8} on es1008 [production]
06:24 <krinkle@tin> Synchronized php-1.27.0-wmf.4/includes/jobqueue/JobQueueRedis.php: (no message) (duration: 00m 18s) [production]
05:11 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Oct 30 05:11:08 UTC 2015 (duration 11m 7s) [production]
04:19 <ori@tin> Synchronized wmf-config/CommonSettings.php: I1d0337b58: ScribuntoSlowFunctionThreshold: 0.90 -> 0.99 (duration: 00m 17s) [production]
04:05 <ori@tin> Synchronized php-1.27.0-wmf.4/extensions/Scribunto/common/Hooks.php: I60b9eb617: When logging perf stats, include wfWikiId() in metric key (duration: 00m 18s) [production]
02:30 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.4) at 2015-10-30 02:30:50+00:00 [production]
02:27 <l10nupdate@tin> Synchronized php-1.27.0-wmf.4/cache/l10n: l10nupdate for 1.27.0-wmf.4 (duration: 06m 13s) [production]