|
2016-03-11
§
|
| 22:50 |
<aaron@tin> |
Synchronized wmf-config/jobqueue-eqiad.php: Disable persistent redis connections and bump timeout a bit (duration: 00m 38s) |
[production] |
| 19:40 |
<jynus> |
restarting dbstore1002 |
[production] |
| 18:51 |
<mutante> |
mw1001 - removed font again, mw1153 confirmed puppet installs it (only) on imagescalers |
[production] |
| 18:42 |
<mutante> |
mw1001 install fonts-gujr-extra to confirm gerrit 276501 is fine |
[production] |
| 17:38 |
<elukey> |
Increased mediawiki::jobrunner::runners_basic to 30 for mw116[123789] |
[production] |
| 16:38 |
<mattflaschen@tin> |
Synchronized wmf-config/InitialiseSettings.php: Comment-only change (duration: 00m 41s) |
[production] |
| 15:44 |
<chasemp> |
labtestmetal and labtestvirt I am commondeering for some nfs and storage testing that cannot be done in labs, I will reimage when done |
[production] |
| 15:41 |
<elukey> |
forced puppet agent -tv on mw1164 |
[production] |
| 15:39 |
<elukey> |
increased mediawiki::jobrunner::runners_basic from 20 to 30 for mw116[3-6] |
[production] |
| 15:26 |
<gehel> |
deploying https://gerrit.wikimedia.org/r/#/c/274382/ - new defined type not used anywhere, should have less than zero impact. |
[production] |
| 15:14 |
<demon@tin> |
Synchronized multiversion/updateBranchPointers: (no message) (duration: 00m 25s) |
[production] |
| 15:12 |
<demon@tin> |
Synchronized wmf-config/throttle.php: Procomuns Viquimarató - Barcelona throttle rule (duration: 00m 31s) |
[production] |
| 15:06 |
<moritzm> |
installing security updates for openssl, curl, gcrypt, libpng, jasper, expat and libxml2 on mw1018-1025 (and restarts of HHVM) |
[production] |
| 15:04 |
<demon@tin> |
Synchronized README: no-op, co-master sync (duration: 00m 30s) |
[production] |
| 15:03 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: moving large.dblist back to wmf.16, did not help |
[production] |
| 14:45 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: moving largest.dblist back to wmf.15 for now |
[production] |
| 14:33 |
<godog> |
run swiftrepl thumbs eqiad -> codfw with concurrency 96 |
[production] |
| 14:25 |
<godog> |
run swiftrepl thumbs eqiad -> codfw with concurrency 128 |
[production] |
| 14:12 |
<moritzm> |
installed security updates for openssl, curl, gcrypt, libpng, jasper, expat and libxml2 on mw1017 (other canaries will be upgraded later on if all is well, the rest of mw* on Monday) |
[production] |
| 13:50 |
<apergos> |
on fluorine truncated archive/redis.log-20160311 and archive/JobQueueFederated.log-20160311 to 5mb each, they were each about 500gb |
[production] |
| 13:26 |
<mobrovac> |
restbase deploy end of 3bedb8f5c42 |
[production] |
| 12:56 |
<mobrovac> |
restbase deploy start of 3bedb8f5c42 on canary restbase1001 |
[production] |
| 12:36 |
<mobrovac> |
mathoid deploying 7a282a4181a4 |
[production] |
| 12:10 |
<moritzm> |
uploaded backport of linux-tools 4.4-4 for jessie-wikimedia to carbon (provides kbuild and perf amonst others) |
[production] |
| 11:48 |
<akosiaris> |
restarting gerrit on ytterbium |
[production] |
| 11:27 |
<jynus> |
running authdns-update to solve a dns typo |
[production] |
| 11:25 |
<jynus> |
killed some long-running git-upload-pack tasks |
[production] |
| 10:26 |
<hashar> |
Gerrit task management documented on https://wikitech.wikimedia.org/wiki/Gerrit#Tasks_management |
[production] |
| 10:11 |
<hashar> |
Gerrit: killed stuck "git-upload-pack '/mediawiki/core.git'" tasks |
[production] |
| 09:46 |
<elukey> |
Rebooting rdb200[56].codfw for kernel upgrade |
[production] |
| 09:13 |
<ema> |
umounted /sys/kernel/debug/tracing on cp1067 |
[production] |
| 09:12 |
<hashar> |
Enabling puppet on gallium.wikimedia.org . Been disabled since ~ Mon Mar 7 10:26:01 UTC 2016 |
[production] |
| 09:07 |
<moritzm> |
uploaded linux-meta 1.9 for jessie-wikimedia to carbon (which now defaults linux-meta to installing Linux 4.4) |
[production] |
| 08:49 |
<ema> |
cp1067: apt-get removed linux-image-3.16.0-4-amd64 and linux-image-4.4.0-1-amd64-dbg to free up some disk space |
[production] |
| 08:20 |
<moritzm> |
restarted hhvm on mw1246, mw1258 |
[production] |
| 08:18 |
<moritzm> |
restarted hhvm on mw1220, mw1244 |
[production] |
| 08:17 |
<moritzm> |
restarted hhvm on mw1174, mw1186, mw1211 |
[production] |
| 07:31 |
<kartik@tin> |
Synchronized php-1.27.0-wmf.16/extensions/ContentTranslation: Deploying 276700 for ContentTranslation (duration: 00m 43s) |
[production] |
| 06:44 |
<_joe_> |
restarted hhvm on mw1166 |
[production] |
| 04:50 |
<ori> |
Uninstalled HHVM on nobelium; not puppetized. |
[production] |
| 04:15 |
<papaul> |
rdb200[5-6] installation complete |
[production] |
| 03:45 |
<papaul> |
rdb200[5-6] signing puppet certs, salt-key, initial run |
[production] |
| 02:57 |
<krenair@tin> |
Synchronized php-1.27.0-wmf.16/extensions/VisualEditor/modules/ve-mw/ui/pages/ve.ui.MWTemplatePage.js: touch - see comment on https://gerrit.wikimedia.org/r/#/c/274120/ (duration: 00m 31s) |
[production] |
| 02:54 |
<papaul> |
installing rdb200[5-6] |
[production] |
| 02:39 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Mar 11 02:39:01 UTC 2016 (duration 8m 45s) |
[production] |
| 02:31 |
<mutante> |
cygnus/technetium: puppet cert clean, salt-key -d (neodymium), puppetstoredconfigclean.rb (rm from Icinga), gnt-instance remove (destroy VMs) |
[production] |
| 02:30 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.16) (duration: 12m 33s) |
[production] |
| 02:23 |
<mutante> |
cygnus - poweroff (for variety) |
[production] |
| 02:21 |
<mutante> |
technetium - shutdown -h now |
[production] |
| 01:25 |
<krinkle@tin> |
Synchronized w/static.php: 6da604f and 49c07ac (duration: 00m 39s) |
[production] |