2015-09-02
ยง
|
19:01 |
<urandom> |
bouncing Cassandra on restbase1001 to address bogus icinga process failure alert |
[production] |
18:52 |
<legoktm> |
deployed patch for T110553 |
[production] |
18:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 wikis to 1.26wmf21 |
[production] |
18:32 |
<cmjohnson1> |
replacing disk 10 on db1028 |
[production] |
18:21 |
<jzerebecki> |
reloading zuul for e0e78c7..3a1658e |
[releng] |
18:15 |
<jzerebecki> |
reloaded zuul for 327dcb6..e0e78c7 |
[releng] |
18:13 |
<urandom> |
bouncing Cassandra on restbase1001 to apply temporary GC settings |
[production] |
17:50 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/VisualEditor/modules/ve-mw/ui/inspectors: https://gerrit.wikimedia.org/r/#/c/235511/ (duration: 00m 12s) |
[production] |
17:07 |
<ori@tin> |
Synchronized php-1.26wmf21/extensions/UniversalLanguageSelector: 78a5908fd9: Updated mediawiki/core Project: mediawiki/extensions/UniversalLanguageSelector (duration: 00m 16s) |
[production] |
17:07 |
<ori@tin> |
Synchronized php-1.26wmf20/extensions/UniversalLanguageSelector: 2154acc529: Updated mediawiki/core Project: mediawiki/extensions/UniversalLanguageSelector (duration: 00m 13s) |
[production] |
16:34 |
<hashar_> |
nodepool .deb package bumped to 0.1.1 . Pending upload to apt.wikimedia.org |
[releng] |
16:34 |
<hashar_> |
nodepool database backend has been setup by ops (thank you Jaime) |
[releng] |
16:33 |
<hashar_> |
ping |
[releng] |
16:25 |
<mutante> |
restarting NTP on lvs2004 |
[production] |
16:12 |
<jynus> |
setting BBU auto-learn mode to warn only (disabled if not possible) on all database hosts |
[production] |
16:02 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/MultimediaViewer/MultimediaViewer.php: https://gerrit.wikimedia.org/r/#/c/235484/ (duration: 00m 12s) |
[production] |
16:01 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/UploadWizard/resources/mw.UploadWizardUploadInterface.js: https://gerrit.wikimedia.org/r/#/c/235486/ (duration: 00m 12s) |
[production] |
15:58 |
<krenair@tin> |
Synchronized php-1.26wmf20/extensions/MultimediaViewer/MultimediaViewer.php: https://gerrit.wikimedia.org/r/#/c/235483/ (duration: 00m 13s) |
[production] |
15:56 |
<krenair@tin> |
Synchronized php-1.26wmf20/extensions/UploadWizard/resources/mw.UploadWizardUploadInterface.js: https://gerrit.wikimedia.org/r/#/c/235485/ (duration: 00m 12s) |
[production] |
15:51 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: T110837 (duration: 00m 13s) |
[production] |
15:42 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/OpenStackManager/nova/OpenStackNovaController.php: https://gerrit.wikimedia.org/r/#/c/235482/ (duration: 00m 12s) |
[production] |
15:33 |
<krenair@tin> |
Synchronized php-1.26wmf20/extensions/OpenStackManager/nova/OpenStackNovaController.php: https://gerrit.wikimedia.org/r/#/c/235479/ (duration: 00m 13s) |
[production] |
15:19 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/ContentTranslation/modules/tools/ext.cx.tools.template.js: https://gerrit.wikimedia.org/r/#/c/235442/ (duration: 00m 12s) |
[production] |
15:14 |
<krenair@tin> |
Synchronized php-1.26wmf20/extensions/ContentTranslation/modules/tools/ext.cx.tools.template.js: https://gerrit.wikimedia.org/r/#/c/235441/ (duration: 00m 12s) |
[production] |
15:09 |
<hashar> |
bumping operations/debs/nodepool upstream branch from 0.1.0 to 0.1.1 ( 462cbe9..3c635ec ) |
[releng] |
15:07 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/234942/ and https://gerrit.wikimedia.org/r/#/c/234944/ (duration: 00m 13s) |
[production] |
14:40 |
<Nikerabbit> |
TTMServer reindex complete |
[production] |
13:58 |
<valhallasw`cloud> |
rebooting tools-exec-1403; https://phabricator.wikimedia.org/T107052 happening, also causing significant NFS server load |
[tools] |
13:55 |
<valhallasw`cloud> |
restarted gridengine_exec on tools-exec-1403 |
[tools] |
13:53 |
<valhallasw`cloud> |
tools-exec-1403 does lots of locking opreations. Only job there was jid 1072678 = /data/project/hat-collector/irc-bots/snitch.py . Rescheduled that job. |
[tools] |
13:16 |
<YuviPanda> |
deleted all jobs of ralgisbot |
[tools] |
13:12 |
<YuviPanda> |
suspended all jobs in ralgisbot temporarily |
[tools] |
12:57 |
<YuviPanda> |
rescheduled all jobs of ralgisbot, was suffering from stale NFS file handles |
[tools] |
11:59 |
<mark> |
removed tools LV snapshots on labstore1002 |
[production] |
11:47 |
<mark> |
kill STOP'ed rsync on labstore1002 |
[production] |
11:00 |
<jynus> |
cloning mysql data from es1002 into es1016 [ETA:16h] |
[production] |
10:30 |
<moritzm> |
installed qemu security updates on labvirt* |
[production] |
09:41 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool es1002 (duration: 00m 12s) |
[production] |
09:21 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool es1010, pool es1017 (duration: 00m 13s) |
[production] |
09:19 |
<hashar> |
Merged in "delete 1.26wmf12" https://gerrit.wikimedia.org/r/235347 which was left unmerged in Gerrit but was present on tin /srv/mediawiki-staging confusing people. |
[production] |
08:03 |
<bblack> |
restarting ntp on lvs2004 |
[production] |
08:01 |
<moritzm> |
enable ferm on db1069/sanitarium |
[production] |
07:50 |
<moritzm> |
enable ferm on remaining phabricator db hosts |
[production] |
04:54 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Sep 2 04:54:37 UTC 2015 (duration 54m 36s) |
[production] |
02:52 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf21) at 2015-09-02 02:52:51+00:00 |
[production] |
02:50 |
<l10nupdate@tin> |
Synchronized php-1.26wmf21/cache/l10n: l10nupdate for 1.26wmf21 (duration: 05m 09s) |
[production] |
02:29 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf20) at 2015-09-02 02:29:56+00:00 |
[production] |
02:26 |
<l10nupdate@tin> |
Synchronized php-1.26wmf20/cache/l10n: l10nupdate for 1.26wmf20 (duration: 06m 31s) |
[production] |
00:33 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/235366/ (duration: 00m 13s) |
[production] |
00:03 |
<wikibugs> |
Updated channels.yaml to: 5f5fbb9243566dd512f1b1bf65ed60e5e08d6e92 Naming is hard |
[tools.wikibugs] |