|
2009-11-08
§
|
| 21:52 |
<Andrew> |
domas says he did some magic with i/o on ixia, replag back to zero. |
[production] |
| 21:51 |
<andrew> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Turning GlobalUsage back on' |
[production] |
| 21:41 |
<mark> |
Experimentally installed unattended-upgrades on server sockpuppet |
[production] |
| 21:41 |
<mark> |
Reboot srv156 |
[production] |
| 21:38 |
<andrew> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Deactivating GlobalUsage to check impact on ixia replag.' |
[production] |
| 21:24 |
<Andrew> |
ixia still has huge replication lag, refreshGlobalImageLinks definitely not still running. |
[production] |
| 18:31 |
<mark> |
Unmounted /home on thistle, ixia, lomaria, db1 and db11 |
[production] |
| 17:26 |
<aaron> |
synchronized php-1.5/extensions/FlaggedRevs/specialpages/Stabilization_body.php 'deployed r58786' |
[production] |
| 16:51 |
<brion> |
taking load off ixia to let it catch up; it's still lagged on GlobalUsage inserts |
[production] |
| 16:51 |
<brion> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 16:09 |
<Bryan> |
Correction: --start-image=Symbol_neutral_vote.svg --start-page=15088846 --maxlag=5 |
[production] |
| 16:04 |
<Bryan> |
Parameters to restart refreshGlobalimagelinks.php with on enwiki: --start-image Symbol_neutral_vote.svg --start-page=15088846 --maxlag 5 |
[production] |
| 16:02 |
<brion> |
stopped andrew's refreshGlobalimagelinks.php job on hume pending fixes and someone to babysit it |
[production] |
| 15:58 |
<brion> |
ixia lag from GlobalUsage population script; Bryan poking at it to make it behave nicer |
[production] |
| 15:55 |
<brion> |
commonswiki | Connect | 510 | NULL | INSERT /* GlobalUsage::setUsage */ INTO `globalimagelinks` (gil_wiki,gil_page,gil_page_namespace,g | |
[production] |
| 15:50 |
<brion> |
circa 8 minutes replag on ixia :( |
[production] |
| 15:30 |
<brion> |
adding missing 'zh' variant URL alias (used for default or something? there's a tab for it) |
[production] |
| 15:25 |
<brion> |
updating all main.conf wiki entries w/ zh variant alias entries (most missing from all but wikipedia.org and wikisource.org) for [[bugzilla:19019]] |
[production] |
| 13:32 |
<mark> |
Shutdown khaldun |
[production] |
| 13:04 |
<brion_> |
restarted parser test loop on wikitech [fixme: make an init script] |
[production] |
| 13:01 |
<brion_> |
parser tests not running since oct 27; looks like wikitech was rebooted then. checking.... |
[production] |
| 10:24 |
<andrew> |
synchronized php-1.5/extensions/GlobalUsage/SpecialGlobalUsage.php 'Deploy r58752' |
[production] |
| 10:21 |
<andrew> |
synchronized php-1.5/extensions/GlobalUsage/GlobalUsage_body.php 'Deploy r58752' |
[production] |
| 09:50 |
<Andrew> |
Set up globalusage for all wikis |
[production] |
| 09:48 |
<andrew> |
synchronized php-1.5/wmf-config/InitialiseSettings.php |
[production] |
| 09:28 |
<apergos> |
cleaned out some space from /tmp and ran apt-get clean on srv218, these should probably become a cron job |
[production] |
| 09:27 |
<andrew> |
synchronized php-1.5/includes/ImagePage.php 'Merge r58692' |
[production] |
| 09:23 |
<Andrew> |
scapping to update GlobalUsage |
[production] |
| 09:20 |
<brion> |
srv218: rsync: write failed on "/apache/common/php-1.5/wmf-config/InitialiseSettings.php": No space left on device (28) |
[production] |
| 09:19 |
<brion> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'adding TimedText namespace on Commons for mdale subtitle awesomeness' |
[production] |
| 08:43 |
<andrew> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Activated LiquidThreads on MediaWiki.org' |
[production] |
| 08:39 |
<Andrew> |
Sticking LiquidThreads in opt-in mode on mediawiki.org |
[production] |
| 05:54 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'putting db1 and db21 live with jafrru dataset' |
[production] |
| 03:58 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'taking out db1 and db21 for new image load' |
[production] |
| 01:04 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'putting db21 back live' |
[production] |
|
2009-11-07
§
|
| 22:14 |
<mark> |
Started puppet on sq44 |
[production] |
| 22:12 |
<mark> |
Unstuck puppet on srv149 |
[production] |
| 22:02 |
<mark> |
Fixed puppet on ixia |
[production] |
| 21:48 |
<mark> |
Installed puppet on yongle |
[production] |
| 21:26 |
<mark> |
Rolling dist-upgrade finished |
[production] |
| 21:12 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'removing db21 from rotation - will be used for migration source' |
[production] |
| 18:35 |
<mark> |
Moved planet.wikimedia.org DNS CNAMEs to singer |
[production] |
| 18:35 |
<mark> |
Setup planet.wikimedia.org instance on singer |
[production] |
| 17:09 |
<mark> |
Moved noc.wikimedia.org CNAME to fenari |
[production] |
| 17:09 |
<mark> |
Setup noc.wikimedia.org instance on fenari, using puppet |
[production] |
| 14:57 |
<mark> |
Doing rolling dist-upgrade of all application servers |
[production] |
| 14:13 |
<mark> |
Removed optsview APT repository on srv225 |
[production] |
| 14:12 |
<mark> |
Removed optsview APT repository on srv224 |
[production] |
| 13:36 |
<mark> |
Manually upgrading puppet across the cluster to help itself get past a catalog bug |
[production] |
| 13:03 |
<mark> |
Setup puppet to automatically upgrade wikimedia-task-appserver on all application servers; in this case it will roll out package php5-geoip across the cluster |
[production] |