651-700 of 10000 results (18ms)
2015-10-27 §
12:58 <akosiaris> disabling puppet and bringing down OTRS service on mendelevium [production]
12:21 <jynus> Just dropped msg_resource tables from labs dbs. Filters modified to stop replicationg them. Started replicating the heartbeat tables. [production]
11:56 <godog> reimage restbase-test2003 [production]
11:23 <godog> cassandra OOM'd on restbase1007, restarting [production]
10:57 <godog> downtime restbase endpoints health for restbase1* while investigating [production]
10:56 <hashar> Jenkins job https://integration.wikimedia.org/ci/job/operations-puppet-doc/ is broken. I am on it :-( [production]
10:50 <hashar> stopping Jenkins due to an unclean state [production]
10:11 <jynus> disabling puppet and restarting mysql servers at db1069- this will create a small amount of lag on labs [production]
09:54 <godog> convert restbase-test2003 to cassandra multi-instance [production]
09:08 <aude@tin> Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Add forceParse UpdaterFlag and option in forceSearchIndex script (duration: 00m 19s) [production]
05:47 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Oct 27 05:47:02 UTC 2015 (duration 47m 1s) [production]
03:42 <krinkle@tin> Synchronized php-1.27.0-wmf.3/languages/Language.php: hotfix for T116693 (duration: 00m 19s) [production]
02:29 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-27 02:29:08+00:00 [production]
02:24 <l10nupdate@tin> Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 06s) [production]
01:02 <krinkle@tin> Synchronized php-1.27.0-wmf.3/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.DesktopArticleTarget.init.js: T116693 (duration: 00m 19s) [production]
00:42 <ori@tin> Synchronized php-1.27.0-wmf.3/extensions/AbuseFilter: I2f84cff0: Avoid pointless range scan for 'load-recent-authors' (T116557) (duration: 00m 18s) [production]
00:11 <krenair@tin> Synchronized php-1.27.0-wmf.3/extensions/Flow/includes/Parsoid/Utils.php: https://gerrit.wikimedia.org/r/#/c/249026 (duration: 00m 18s) [production]
2015-10-26 §
23:29 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248371/ (duration: 00m 20s) [production]
23:22 <krenair@tin> Synchronized wmf-config/extension-list-labs: https://gerrit.wikimedia.org/r/#/c/248632/ (duration: 00m 17s) [production]
23:19 <krenair@tin> Synchronized w/static/images/project-logos/vecwiki.png: https://gerrit.wikimedia.org/r/#/c/248633/ (duration: 00m 18s) [production]
23:17 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248478/ (duration: 00m 17s) [production]
23:16 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248475/ (duration: 00m 17s) [production]
23:15 <krenair@tin> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/248475/ (duration: 00m 17s) [production]
23:06 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248871/3 (duration: 00m 18s) [production]
21:48 <cmjohnson1> powering off wdqs1001 to update idrac settings [production]
20:50 <subbu> deployed parsoid version 660c59a9 [production]
20:21 <ebernhardson> started copy of eqiad elasticsearch indices to noeblium [production]
20:19 <YuviPanda> stress test on nobelium complete, CPU temperature didn't go above 65C [production]
20:13 <paravoid> deactivating ulsfo<->NTT BGP peering due to upcoming network migration [production]
20:05 <YuviPanda> running stress on nobelium [production]
19:36 <cmjohnson1> swapped bad disk on db1030 [production]
15:44 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/WikimediaEvents.php: Re-deploy WME changes after deploying necessary CirrusSearch change first (duration: 00m 18s) [production]
15:43 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/modules: Re-deploy WME changes after deploying necessary CirrusSearch change first (duration: 00m 17s) [production]
15:30 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Undeploy eventlogging search schema from CirrusSearch (duration: 00m 18s) [production]
15:21 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents: rollback (duration: 00m 18s) [production]
15:13 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/WikimediaEvents.php: Move search schema from cirrussearch -> wikimediavents (duration: 00m 19s) [production]
15:13 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/modules/: Move search schema from cirrussearch -> wikimediavents (duration: 00m 17s) [production]
15:06 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/WikimediaEvents.php: Update satisfaction schema id due to bad varnish caching of old id (duration: 00m 17s) [production]
15:04 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: Remove Predundant Page and Index namespaces from $wgContentNamespaces (duration: 00m 17s) [production]
14:58 <bblack> repooling cp1059 varnish mobile frontend (wiped) [production]
14:18 <aude@tin> Synchronized wmf-config/InitialiseSettings.php: Enable GeoData on Wikidata (duration: 00m 17s) [production]
14:09 <aude@tin> Synchronized wmf-config/InitialiseSettings.php: Enable geosearch on test.wikidata (duration: 00m 17s) [production]
13:32 <aude@tin> Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Add justMapping option to updateOneSearchIndexConfig script (updated submodule) (duration: 00m 18s) [production]
13:26 <aude@tin> Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Add justMapping option to updateOneSearchIndexConfig script (duration: 00m 18s) [production]
09:42 <dcausse> deleting unused elasticsearch indices in eqiad (T112863) [production]
09:20 <_joe_> restarting etcd on conf1001 [production]
09:16 <jynus> rebooting and installing jessie on db2060-db2070 [production]
05:48 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Oct 26 05:48:19 UTC 2015 (duration 48m 18s) [production]
02:31 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-26 02:31:46+00:00 [production]
02:27 <l10nupdate@tin> Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 14s) [production]