|
2015-10-27
§
|
| 12:21 |
<jynus> |
Just dropped msg_resource tables from labs dbs. Filters modified to stop replicationg them. Started replicating the heartbeat tables. |
[production] |
| 11:56 |
<godog> |
reimage restbase-test2003 |
[production] |
| 11:23 |
<godog> |
cassandra OOM'd on restbase1007, restarting |
[production] |
| 10:57 |
<godog> |
downtime restbase endpoints health for restbase1* while investigating |
[production] |
| 10:56 |
<hashar> |
Jenkins job https://integration.wikimedia.org/ci/job/operations-puppet-doc/ is broken. I am on it :-( |
[production] |
| 10:50 |
<hashar> |
stopping Jenkins due to an unclean state |
[production] |
| 10:11 |
<jynus> |
disabling puppet and restarting mysql servers at db1069- this will create a small amount of lag on labs |
[production] |
| 09:54 |
<godog> |
convert restbase-test2003 to cassandra multi-instance |
[production] |
| 09:08 |
<aude@tin> |
Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Add forceParse UpdaterFlag and option in forceSearchIndex script (duration: 00m 19s) |
[production] |
| 05:47 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Oct 27 05:47:02 UTC 2015 (duration 47m 1s) |
[production] |
| 03:42 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.3/languages/Language.php: hotfix for T116693 (duration: 00m 19s) |
[production] |
| 02:29 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-27 02:29:08+00:00 |
[production] |
| 02:24 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 06s) |
[production] |
| 01:02 |
<krinkle@tin> |
Synchronized php-1.27.0-wmf.3/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.DesktopArticleTarget.init.js: T116693 (duration: 00m 19s) |
[production] |
| 00:42 |
<ori@tin> |
Synchronized php-1.27.0-wmf.3/extensions/AbuseFilter: I2f84cff0: Avoid pointless range scan for 'load-recent-authors' (T116557) (duration: 00m 18s) |
[production] |
| 00:11 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.3/extensions/Flow/includes/Parsoid/Utils.php: https://gerrit.wikimedia.org/r/#/c/249026 (duration: 00m 18s) |
[production] |
|
2015-10-26
§
|
| 23:29 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248371/ (duration: 00m 20s) |
[production] |
| 23:22 |
<krenair@tin> |
Synchronized wmf-config/extension-list-labs: https://gerrit.wikimedia.org/r/#/c/248632/ (duration: 00m 17s) |
[production] |
| 23:19 |
<krenair@tin> |
Synchronized w/static/images/project-logos/vecwiki.png: https://gerrit.wikimedia.org/r/#/c/248633/ (duration: 00m 18s) |
[production] |
| 23:17 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248478/ (duration: 00m 17s) |
[production] |
| 23:16 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248475/ (duration: 00m 17s) |
[production] |
| 23:15 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/248475/ (duration: 00m 17s) |
[production] |
| 23:06 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/248871/3 (duration: 00m 18s) |
[production] |
| 21:48 |
<cmjohnson1> |
powering off wdqs1001 to update idrac settings |
[production] |
| 20:50 |
<subbu> |
deployed parsoid version 660c59a9 |
[production] |
| 20:21 |
<ebernhardson> |
started copy of eqiad elasticsearch indices to noeblium |
[production] |
| 20:19 |
<YuviPanda> |
stress test on nobelium complete, CPU temperature didn't go above 65C |
[production] |
| 20:13 |
<paravoid> |
deactivating ulsfo<->NTT BGP peering due to upcoming network migration |
[production] |
| 20:05 |
<YuviPanda> |
running stress on nobelium |
[production] |
| 19:36 |
<cmjohnson1> |
swapped bad disk on db1030 |
[production] |
| 15:44 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/WikimediaEvents.php: Re-deploy WME changes after deploying necessary CirrusSearch change first (duration: 00m 18s) |
[production] |
| 15:43 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/modules: Re-deploy WME changes after deploying necessary CirrusSearch change first (duration: 00m 17s) |
[production] |
| 15:30 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Undeploy eventlogging search schema from CirrusSearch (duration: 00m 18s) |
[production] |
| 15:21 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents: rollback (duration: 00m 18s) |
[production] |
| 15:13 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/WikimediaEvents.php: Move search schema from cirrussearch -> wikimediavents (duration: 00m 19s) |
[production] |
| 15:13 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/modules/: Move search schema from cirrussearch -> wikimediavents (duration: 00m 17s) |
[production] |
| 15:06 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/WikimediaEvents.php: Update satisfaction schema id due to bad varnish caching of old id (duration: 00m 17s) |
[production] |
| 15:04 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Remove Predundant Page and Index namespaces from $wgContentNamespaces (duration: 00m 17s) |
[production] |
| 14:58 |
<bblack> |
repooling cp1059 varnish mobile frontend (wiped) |
[production] |
| 14:18 |
<aude@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable GeoData on Wikidata (duration: 00m 17s) |
[production] |
| 14:09 |
<aude@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable geosearch on test.wikidata (duration: 00m 17s) |
[production] |
| 13:32 |
<aude@tin> |
Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Add justMapping option to updateOneSearchIndexConfig script (updated submodule) (duration: 00m 18s) |
[production] |
| 13:26 |
<aude@tin> |
Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Add justMapping option to updateOneSearchIndexConfig script (duration: 00m 18s) |
[production] |
| 09:42 |
<dcausse> |
deleting unused elasticsearch indices in eqiad (T112863) |
[production] |
| 09:20 |
<_joe_> |
restarting etcd on conf1001 |
[production] |
| 09:16 |
<jynus> |
rebooting and installing jessie on db2060-db2070 |
[production] |
| 05:48 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Oct 26 05:48:19 UTC 2015 (duration 48m 18s) |
[production] |
| 02:31 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-26 02:31:46+00:00 |
[production] |
| 02:27 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 14s) |
[production] |