|
2012-05-25
§
|
| 13:50 |
<RobH> |
palladium has a bad disk, goign to replace it |
[production] |
| 13:37 |
<RobH> |
updating drac on search18, shouldnt cause system reboot. |
[production] |
| 10:42 |
<apergos> |
restarted apache on kaulen, was seeing page.cgi segfaults in dmesg and he logs, huge cpu wait spikes (why?) |
[production] |
| 08:38 |
<beta-logmsgbot> |
root: on dbdump, deleted /etc/logrotate.d/mw-udp2log . Most probably in conflict with the one from deployment-feed which host the udp2log process |
[releng] |
| 08:35 |
<beta-logmsgbot> |
root: gzipped /home/wikipedia/logs/archive/*20120525 see {{bug|37012}} :-( |
[releng] |
| 08:23 |
<beta-logmsgbot> |
hashar: killed stuck jobs on jobrunner 02 and 03. Restarted loop. |
[releng] |
|
2012-05-24
§
|
| 23:34 |
<awjrichards> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 23:32 |
<awjrichards> |
synchronized wmf-config/CommonSettings.php 'Updating technical feedback email address for mobile feedback' |
[production] |
| 23:17 |
<awjrichards> |
synchronizing Wikimedia installation... : Picking up changes to hide feedback form to prevent spamming of mobile feedback page - f6ed8ba |
[production] |
| 23:12 |
<awjrichards> |
synchronized wmf-config/CommonSettings.php 'Enabling 'technical feedback' link on mobile feedback form to disable feedback form' |
[production] |
| 23:00 |
<binasher> |
stopped replication on es1002 in order to rsync cluster23 to es1003 |
[production] |
| 21:53 |
<aaron> |
synchronized php-1.20wmf3/extensions/UploadWizard 'deployed 144b58854e38d910210ccd23402225e5b1d2d62d' |
[production] |
| 21:52 |
<RoanKattouw> |
Restarted morebots |
[production] |
| 11:52 |
<beta-logmsgbot> |
hashar: Rewrote log command to use dologmsg and the new beta-logmsgbot |
[releng] |
| 11:51 |
<beta-logmsgbot> |
hashar: yeah I do log |
[releng] |
| 11:47 |
<hashar> |
Moving /bin/log to /usr/local/bin/log |
[releng] |
| 11:45 |
<labs-logs-bottie> |
hashar: installing php5-dev and running `pecl install parsekit` on deployment-dbdump |
[releng] |
| 09:43 |
<labs-logs-bottie> |
hashar: installing php5-dev and running `pecl install parsekit` on deployment-dbdump |
[releng] |
| 09:42 |
<labs-logs-bottie> |
hashar: installing php5-dev and running `pecl install parsekit` |
[releng] |
| 07:05 |
<hashar> |
killed some stalled jobs on jobrunner02 |
[releng] |
| 02:56 |
<labs-logs-bottie> |
jeremyb: foo |
[releng] |
|
2012-05-23
§
|
| 21:46 |
<binasher> |
shutting down mysql on db12 in able to restart with binlogging disabled |
[production] |
| 21:45 |
<asher> |
synchronized wmf-config/db.php 'pulling db12 from enwiki, moving watchlist / special queries to db60' |
[production] |
| 21:34 |
<ottomata1> |
upgraded udp-filter to 0.2.4 on oxygen, emery, and locke (with maplebed's help) |
[production] |
| 19:54 |
<hashar> |
rebooting apache20 following installation of imagescaler puppet class |
[releng] |
| 19:49 |
<hashar> |
rebooting apache23 following installation of imagescaler puppet class |
[releng] |
| 19:46 |
<hashar> |
rebooting apache22 following installation of imagescaler puppet class |
[releng] |
| 19:15 |
<hashar> |
rebooting apache21 following installation of imagescaler puppet class |
[releng] |
| 18:48 |
<hashar> |
Adding puppet class 'imagescaler' on all deployment-apacheXX instances in an attempt to fix thumbnails |
[releng] |
| 18:36 |
<labs-logs-bottie> |
hashar: relocalisation cache done 367/367 languages rebuilt |
[releng] |
| 18:28 |
<labs-logs-bottie> |
hashar: running `mwscript rebuildLocalisationCache.php --wiki=aawiki` for {{bug|36806}} |
[releng] |
| 18:11 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Last 286 wikis over to 1.20wmf3 |
[production] |
| 17:35 |
<maplebed> |
deployed change to varnish configs for preilly; adding more carriers |
[production] |
| 17:13 |
<ben> |
synchronized wmf-config/CommonSettings.php 'changing the URL for the mobile feedback page to the Project namespace' |
[production] |
| 17:12 |
<preilly> |
synchronized php-1.20wmf2/extensions/MobileFrontend/ 'RL hack' |
[production] |
| 17:00 |
<reedy> |
synchronized wmf-config/ 'Tidying unpushed changes' |
[production] |
| 16:22 |
<labs-logs-bottie> |
hashar: delete all 3 webVideoTranscode jobs from enwiki database |
[releng] |
| 16:10 |
<hashar> |
rebooted jobrunner03 to check everything works fine there |
[releng] |
| 15:41 |
<hashar> |
deleting jobrunner01, it is crashed beyond repair. Will create a new one named jobrunner03 |
[releng] |
| 15:35 |
<RobH> |
ns1 died on update, restarting pdns |
[production] |
| 15:34 |
<RobH> |
updated dns for analytics mgmt |
[production] |
| 15:27 |
<hashar> |
rebooting jobrunner01 to see how it goes |
[releng] |
| 14:56 |
<hashar> |
stopped job runner on jobrunner01, amounted /mnt/upload6 and /mnt/ |
[releng] |
| 14:37 |
<hashar> |
running puppet on job runner to check change 8584 & 8585 worked |
[releng] |
| 02:45 |
<LocalisationUpdate> |
completed (1.20wmf2) at Wed May 23 02:45:44 UTC 2012 |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.20wmf3) at Wed May 23 02:23:33 UTC 2012 |
[production] |
| 01:12 |
<K4-713> |
synchronized payments cluster to DonationInterface 4be175e43f |
[production] |
| 00:16 |
<Ryan_Lane> |
flushed the varnish cache for mobile again |
[production] |
| 00:13 |
<preilly> |
synchronized php-1.20wmf3/extensions/MobileFrontend/ 'try again' |
[production] |
| 00:11 |
<preilly> |
synchronized php-1.20wmf3/extensions/MobileFrontend/ 'try again' |
[production] |