7901-7950 of 10000 results (41ms)
2016-01-19 §
20:13 <mutante> ruthenium: disable puppet, copy data over to osmium (screen) [production]
20:12 <mutante> ruthenium: service mysql stop [production]
20:08 <mforns> deployed eventlogging to deployment-eventlogging03 with removal of mysql consumer batch [analytics]
19:34 <legoktm> deleting all *zend* jobs from jenkins [releng]
19:15 <catrope@tin> catrope@tin Synchronized wmf-config/CommonSettings.php: EventBus plumbing (duration: 00m 30s) [production]
19:14 <catrope@tin> catrope@tin Synchronized wmf-config/InitialiseSettings.php: Disable Flow on wikitech; add EventBus plumbing (duration: 00m 31s) [production]
19:13 <catrope@tin> catrope@tin Synchronized wmf-config/extension-list: Add EventBus (duration: 00m 31s) [production]
19:00 <marxarelli> starting branch cut for 1.27.0-wmf.11 [production]
18:42 <ema> Starting migration of mobile traffic to text cluster https://phabricator.wikimedia.org/T109286 [production]
17:54 <krenair@tin> krenair@tin Synchronized php-1.27.0-wmf.10/extensions/UploadWizard/UploadWizard.config.php: https://gerrit.wikimedia.org/r/#/c/264969/ (duration: 00m 31s) [production]
16:51 <krenair@tin> krenair@tin Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/264964/ (duration: 00m 31s) [production]
16:47 <krenair@tin> krenair@tin Synchronized php-1.27.0-wmf.10/extensions/Graph/modules/graph-loader.js: https://gerrit.wikimedia.org/r/#/c/264715/ (duration: 00m 31s) [production]
16:45 <krenair@tin> krenair@tin Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/264469/ (duration: 00m 31s) [production]
16:41 <krenair@tin> krenair@tin Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/264437/ (duration: 00m 32s) [production]
14:58 <cmjohnson1> reseating asw-c-eqiad uplink module (xe-1/1/0 and xe-1/1/2) [production]
14:29 <jynus> reimporting some fawiki tables from production into labsdb hosts [production]
13:52 <godog> powercycle ms-be1001 [production]
13:51 <paravoid> powercycling alsafi [production]
09:40 <hashar> Created github repo https://github.com/wikimedia/operations-debs-varnish4 [releng]
03:59 <legoktm> deploying https://gerrit.wikimedia.org/r/264912 and https://gerrit.wikimedia.org/r/264922 [releng]
02:53 <l10nupdate@tin> l10nupdate@tin ResourceLoader cache refresh completed at Tue Jan 19 02:53:40 UTC 2016 (duration 7m 0s) [production]
02:46 <mwdeploy@tin> mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 09m 21s) [production]
02:26 <mwdeploy@tin> mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 10m 40s) [production]
2016-01-18 §
23:26 <krenair@tin> krenair@tin Synchronized multiversion/MWMultiVersion.php: https://gerrit.wikimedia.org/r/264895 (duration: 00m 31s) [production]
22:56 <krenair@tin> krenair@tin Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/264786/ (duration: 00m 32s) [production]
22:55 <krenair@tin> krenair@tin rebuilt wikiversions.php and synchronized wikiversions files: (no message) [production]
22:55 <krenair@tin> krenair@tin Synchronized dblists: (no message) (duration: 00m 31s) [production]
22:53 <krenair@tin> krenair@tin Synchronized w/static/images/project-logos/wikitech.png: https://gerrit.wikimedia.org/r/#/c/264786/ (duration: 00m 31s) [production]
17:30 <krenair@tin> krenair@tin Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/264758 - labs-only change (duration: 00m 36s) [production]
14:49 <ottomata> restarting eventlogging to un-blacklist MobileWebSectionUsage [analytics]
14:24 <godog> powercycle praseodymium [production]
10:42 <godog> powercycle ms-be2016, high load avg [production]
10:16 <godog> dist-upgrade ms-be3002 to trusty [production]
02:57 <l10nupdate@tin> l10nupdate@tin ResourceLoader cache refresh completed at Mon Jan 18 02:57:41 UTC 2016 (duration 7m 8s) [production]
02:50 <mwdeploy@tin> mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 08m 39s) [production]
02:49 <YuviPanda> updated annualreport for foks [production]
02:30 <mwdeploy@tin> mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 11m 38s) [production]
01:07 <ottomata> restarted eventlogging again. A single raw client side processor consumer seemed stuck (according to burrow). seeing offset commit errors in logs. [analytics]
2016-01-17 §
18:02 <legoktm> deploying https://gerrit.wikimedia.org/r/264605 [releng]
08:26 <ottomata> restarting eventlogging to see if it'll help burrow reported kafka consumer lag [analytics]
04:58 <YuviPanda> started restbase on restbase1002 [production]
02:53 <l10nupdate@tin> l10nupdate@tin ResourceLoader cache refresh completed at Sun Jan 17 02:53:19 UTC 2016 (duration 6m 59s) [production]
02:46 <mwdeploy@tin> mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 08m 53s) [production]
02:26 <mwdeploy@tin> mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 10m 41s) [production]
01:47 <paravoid> restarting HHVM on mw1120, mw1125, mw1127, mw1132, mw1148; OOM [production]
2016-01-16 §
21:47 <legoktm> deploying https://gerrit.wikimedia.org/r/264489 [releng]
21:36 <legoktm> deploying https://gerrit.wikimedia.org/r/264488 [releng]
21:29 <legoktm> deploying https://gerrit.wikimedia.org/r/264487 [releng]
21:21 <legoktm> deploying https://gerrit.wikimedia.org/r/264483 https://gerrit.wikimedia.org/r/264485 [releng]
20:58 <legoktm> deploying https://gerrit.wikimedia.org/r/264492 [releng]