2013-10-15
§
|
17:49 |
<mutante> |
enable icinga notifications for db1006 services |
[production] |
17:42 |
<ariel> |
synchronized wmf-config/db-eqiad.php 'db1022 (s6) back in the pool' |
[production] |
16:42 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'enwikisource getting cirrus as primary' |
[production] |
16:36 |
<bd808> |
synchronized php-1.22wmf21/maintenance/purgeChangedPages.php 'Updating purgeChangedPages.php to prepare for HTCP purge' |
[production] |
16:31 |
<bd808> |
synchronized php-1.22wmf20/maintenance/purgeChangedPages.php |
[production] |
16:28 |
<bd808> |
synchronized php-1.22wmf20/maintenance/purgeChangedPages.php |
[production] |
16:23 |
<bd808> |
synchronized php-1.22wmf20/maintenance/purgeChangedPages.php |
[production] |
15:04 |
<reedy> |
synchronized php-1.22wmf21/extensions/Wikibase |
[production] |
14:35 |
<reedy> |
synchronized multiversion/ 'Changing away from docroot based site deduction' |
[production] |
13:31 |
<ariel> |
synchronized wmf-config/db-eqiad.php 'db1006 (s6) back to full weight in pool' |
[production] |
11:37 |
<hashar> |
jenkins refreshing all mediawiki extensions jobs so they log Junit results under /logs/ |
[production] |
10:29 |
<ariel> |
synchronized wmf-config/db-eqiad.php 'db1006 (s6) repooled, warming up after upgrade/conversion' |
[production] |
06:56 |
<ariel> |
synchronized wmf-config/db-eqiad.php 'db1022 (s6) depooled to use as clone source' |
[production] |
05:18 |
<apergos> |
powercycled cp1052, it was unresponsive and unreachable via mgmt |
[production] |
02:37 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Oct 15 02:37:39 UTC 2013 |
[production] |
02:20 |
<LocalisationUpdate> |
completed (1.22wmf21) at Tue Oct 15 02:20:18 UTC 2013 |
[production] |
02:14 |
<LocalisationUpdate> |
completed (1.22wmf20) at Tue Oct 15 02:14:53 UTC 2013 |
[production] |
01:53 |
<Tim> |
rebooting mw1035 for init testing |
[production] |
00:41 |
<Tim> |
manually created MW cgroups on all apaches since apparently the init script is totally broken |
[production] |
00:29 |
<Tim> |
on mw1035,mw1145,mw1078,mw1152,mw1150: running "start cgconfig" to fix cgroups |
[production] |
00:21 |
<Tim> |
some apaches are missing /sys/fs/cgroup/* so shell execution from MW fails. Stopped apache on mw1035 during investigation |
[production] |
2013-10-14
§
|
23:46 |
<tstarling> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
23:42 |
<tstarling> |
synchronized php-1.22wmf20/extensions/Math |
[production] |
23:41 |
<Tim> |
pushed out temporary checkout of extension/Math 679ce7fe2fe, will update submodule soon |
[production] |
23:40 |
<tstarling> |
synchronized php-1.22wmf20/extensions/Math/MathTexvc.php |
[production] |
23:14 |
<olivneh> |
synchronized wmf-config/InitialiseSettings.php 'Disable Math debug log group (found to be not pertinent & too verbose)' |
[production] |
22:21 |
<olivneh> |
synchronized wmf-config/InitialiseSettings.php 'Enable Math debug log group' |
[production] |
16:11 |
<mark> |
Setup LVS service IP range aggregates on the core routers |
[production] |
06:45 |
<apergos> |
resized /var/lib/puppet on stafford, it ran out of room last night (but recovered after cron job reports cleanup) |
[production] |
05:18 |
<springle> |
synchronized wmf-config/db-pmtpa.php 'update s6 master' |
[production] |
05:17 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1007' |
[production] |
04:34 |
<springle> |
synchronized wmf-config/db-pmtpa.php 'update s6 master' |
[production] |
04:24 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1006 to investigate connection errors. promote db1027' |
[production] |
03:33 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1027 before promotion' |
[production] |
02:25 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Oct 14 02:25:24 UTC 2013 |
[production] |
02:15 |
<LocalisationUpdate> |
completed (1.22wmf21) at Mon Oct 14 02:15:08 UTC 2013 |
[production] |
02:08 |
<LocalisationUpdate> |
completed (1.22wmf20) at Mon Oct 14 02:08:37 UTC 2013 |
[production] |