|
2012-04-17
§
|
| 18:36 |
<binasher> |
pulling sq68 from pybal for a bit |
[production] |
| 18:29 |
<RoanKattouw> |
Did a graceful restart of all job runners using dsh about 15 mins ago |
[production] |
| 18:29 |
<RoanKattouw> |
Restarted morebots |
[production] |
| 07:44 |
<apergos> |
morebots test |
[production] |
| 07:44 |
<apergos> |
restarted varnish service manually a bit a go on sq67 and sq70, the cron job didn't seem to have gone off. restarted morebots too while I was at it |
[production] |
| 03:37 |
<Jeff_Green> |
dist-upgrade arsenic |
[production] |
| 03:29 |
<LeslieCarr> |
restarting varnish on arsenic again |
[production] |
| 03:12 |
<maplebed> |
started a script to delete old objects on ms-be1 for swift truncated object cleaning |
[production] |
| 02:53 |
<Jeff_Green> |
dist-upgrade on strontium |
[production] |
| 02:43 |
<LeslieCarr> |
restarted varnish on arsenic |
[production] |
| 02:26 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf1) at Tue Apr 17 02:26:40 UTC 2012 |
[production] |
| 02:17 |
<logmsgbot_> |
LocalisationUpdate completed (1.19) at Tue Apr 17 02:17:24 UTC 2012 |
[production] |
| 01:44 |
<LeslieCarr> |
restarting varnish on niobium |
[production] |
| 00:52 |
<LeslieCarr> |
reloading amslvs4 |
[production] |
| 00:27 |
<logmsgbot_> |
aaron synchronized php-1.20wmf1/includes/filerepo 'deployed 552ff0f482f3e65e9795fe304dd810e9ae1b03fb' |
[production] |
|
2012-04-16
§
|
| 23:31 |
<logmsgbot_> |
catrope synchronizing Wikimedia installation... : Now with a touch of the specific WikiEditor.i18n.php file |
[production] |
| 23:11 |
<logmsgbot_> |
catrope synchronizing Wikimedia installation... : Hopefully fixing the WikiEditor messages this time, now with MessagesEn.php touch |
[production] |
| 23:07 |
<logmsgbot_> |
catrope synchronizing Wikimedia installation... : Hopefully fixing the WikiEditor messages this time |
[production] |
| 22:58 |
<logmsgbot_> |
awjrichards synchronizing Wikimedia installation... : Updating MobileFrontend to [[rev:114934|r114934]] |
[production] |
| 22:49 |
<logmsgbot_> |
catrope synchronizing Wikimedia installation... : Need to run scap for this WikiEditor change, contains i18n changes |
[production] |
| 22:39 |
<logmsgbot_> |
catrope synchronized php-1.20wmf1/extensions/WikiEditor/ 'Deploy WikiEditor revert' |
[production] |
| 20:53 |
<logmsgbot_> |
catrope synchronized php-1.20wmf1/extensions/WikiEditor/ 'Actually deploy the recent WikiEditor fixes' |
[production] |
| 18:58 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: Commons Wiki to 1.20wmf1 |
[production] |
| 18:47 |
<logmsgbot_> |
reedy synchronized php-1.20wmf1/resources/mediawiki/mediawiki.js |
[production] |
| 18:46 |
<logmsgbot_> |
reedy synchronized php-1.20wmf1/extensions/WikiEditor |
[production] |
| 18:37 |
<mutante> |
manually added iptables nat rules on nfs2 |
[production] |
| 18:13 |
<notpeter> |
upgrade of udp2log on nfs1/2 complete. should be operating normally now. |
[production] |
| 17:41 |
<mutante> |
LDAP on nfs2 warnings - opendj was _just_ started there when puppet was fixed with an unrelated issue |
[production] |
| 17:38 |
<mutante> |
restarting opendj on nfs2 because it refused connections |
[production] |
| 17:08 |
<logmsgbot_> |
preilly synchronized php-1.19/extensions/ZeroRatedMobileAccess/ 'zero and mobile changes' |
[production] |
| 16:07 |
<notpeter> |
upgrading and restarting udp2log on nfs1/2 |
[production] |
| 15:04 |
<mutante> |
puppet fresh on nfs[12] after removing nonexistent misc::mediawiki-logger class |
[production] |
| 14:46 |
<mark> |
Shutdown db24 for memory testing by Chris |
[production] |
| 13:27 |
<mark> |
Sending European bits traffic back to pmtpa |
[production] |
| 12:24 |
<mark> |
Sending European bits traffic back to esams |
[production] |
| 12:06 |
<mark> |
Testing sess_leak_fix2 patch with a snapshot varnish build on cp3001 |
[production] |
| 11:56 |
<Reedy> |
Ran ddsh -cM -g mediawiki-installation -o -oSetupTimeout=30 -- "cd /usr/local/apache/common && sudo -u mwdeploy ln -s php php-1.18" to create symlink for php-1.18 |
[production] |
| 11:51 |
<Reedy> |
Killing php-1.18 again |
[production] |
| 11:48 |
<mutante> |
sq34 - System halted! Error: Internal Storage Slot, powered down, -> RT |
[production] |
| 11:45 |
<logmsgbot_> |
reedy synchronized php-1.18/ 'Symlink php-1.18 back to php (our current main running version) as lots of requests on bits are for 1.18 resources' |
[production] |
| 11:44 |
<mutante> |
sq34 was broken and died when connecting to mgmt, powercycling |
[production] |
| 11:37 |
<mutante> |
nfs1 - Could not find class misc::mediawiki-logger for nfs1 |
[production] |
| 10:57 |
<Krinkle> |
bits.wikimedia.org back up, mark fixed it. |
[production] |
| 10:33 |
<Krinkle> |
bits.wikimedia.org serving Error 503 Service Unavailable on all load.php requests for mediawiki.org and nl.wikipedia.org, maybe more |
[production] |
| 09:45 |
<logmsgbot_> |
reedy synchronized wmf-config/InitialiseSettings.php 'Set wgEnableJavaScriptTest to true for test2wiki' |
[production] |
| 02:26 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf1) at Mon Apr 16 02:26:58 UTC 2012 |
[production] |
| 02:18 |
<logmsgbot_> |
LocalisationUpdate completed (1.19) at Mon Apr 16 02:17:57 UTC 2012 |
[production] |