|
2009-12-07
§
|
| 16:10 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'removed duplicate ptwikisource config (autopromote setting must have been broken)' |
[production] |
| 14:37 |
<mark> |
Drive 0 SMART predicted failure on fuchsia |
[production] |
| 14:36 |
<mark> |
Power cycling fuchsia |
[production] |
| 14:31 |
<mark> |
Enabled knsq7 frontend squid in pybal |
[production] |
| 14:31 |
<RoanKattouw> |
Running namespaceDupes on nlwiki for bug 21722 |
[production] |
| 14:30 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 21722: Add WP, H, P aliases for nlwiki' |
[production] |
| 13:59 |
<mark> |
synchronized php-1.5/wmf-config/mc.php 'Removed decommissioned servers, added in a few more spares' |
[production] |
| 13:57 |
<mark> |
Updated memcached list in puppet, wielded out old/down/decommissioned servers |
[production] |
| 13:23 |
<mark> |
Removed memcached from srv151-153, 156 |
[production] |
| 13:19 |
<root> |
synchronized php-1.5/wmf-config/mc.php 'Replaced srv151,152,153,156 by new memcached nodes, added ~30 new spares' |
[production] |
| 13:04 |
<mark> |
Installed memcached on srv226..253 |
[production] |
| 11:42 |
<Andrew> |
Ran sync-common on srv125, srv156 as they missed some of the most recent updates. |
[production] |
| 11:37 |
<andrew> |
synchronized php-1.5/wmf-config/ExtensionMessages.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:36 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/pages/ThreadPermalinkView.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:36 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/pages/TalkpageView.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:33 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/pages/SpecialNewMessages.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:33 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/lqt.js 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:30 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/i18n/Lqt.i18n.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:29 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/classes/View.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:28 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/classes/ThreadRevision.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:24 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/classes/Thread.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:22 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads_alpha/api/ApiThreadAction.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:22 |
<andrew> |
synchronized php-1.5/extensions/LiquidThreads/i18n/Lqt.i18n.php 'Updating LiquidThreads alpha to trunk state (r59781)' |
[production] |
| 11:16 |
<Andrew> |
Some root-owned .svn directories spread throughout wmf-deployment. |
[production] |
| 11:13 |
<Andrew> |
Updating LiquidThreads alpha to trunk state, this time by quickly sync-file-ing each individual file in a for loop so I don't bring down the site with scap |
[production] |
| 10:12 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'full load on db30' |
[production] |
| 00:51 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'reducing load for some inspection' |
[production] |
|
2009-12-06
§
|
| 23:39 |
<domas> |
s2 slave load is being handled by single 5.1-wm-3139 server |
[production] |
| 23:23 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'wheeeeeeeeee' |
[production] |
| 23:12 |
<domas> |
srv83 was not in sync groups, but alive and serving load.. |
[production] |
| 22:50 |
<mark> |
...on db30 :P |
[production] |
| 22:50 |
<domas> |
and yes, it was db30 |
[production] |
| 22:17 |
<domas> |
s/bank8/bank9/ |
[production] |
| 22:15 |
<domas> |
bank13 & bank8 MCE warnings ( http://p.defau.lt/?KWMB35Z13ysXpN6IHcca9A ) |
[production] |
| 22:13 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 20:22 |
<mark> |
Puppetized NTP configuration on the Solaris servers |
[production] |
| 19:37 |
<mark> |
Installed CSW pkgutil and puppet on ms4, updated it on ms5 |
[production] |
| 18:00 |
<apergos> |
resending incrementals for last three months from ms1 to ms7 with -I to get the intermediate snaps. using netcat, running in screen as root on both hosts |
[production] |
| 15:54 |
<apergos> |
cleaned up / on ms1, was out of space (tossed some old files from /root) |
[production] |
| 01:20 |
<mark> |
Disabled xinetd and extdist crontab on zwinger |
[production] |
| 00:40 |
<mark> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Moved svn-invoker (ExtensionDistributor) from zwinger to fenari' |
[production] |
| 00:27 |
<mark> |
sq27 is flooding syslog; placed temporary firewall entry for syslog packets on nfs1 |
[production] |