|
2012-04-25
§
|
| 12:24 |
<hashar> |
added a basic puppet skeleton in manifests/labs/beta/ with https://gerrit.wikimedia.org/r/5790 (test branch) |
[releng] |
| 11:39 |
<mutante> |
running authdns-update to add analysis mgmt names |
[production] |
| 11:39 |
<hashar> |
manually purged debian package `ack`, installed `ack-grep` |
[releng] |
| 11:22 |
<hashar> |
puppet finished migration of web{3,4,5} to apache::service |
[releng] |
| 11:19 |
<hashar> |
changed squid visible name to squid001.beta.wmflabs.org |
[releng] |
| 11:02 |
<hashar> |
migrate web{3,4,5} from webserver::php5 to apaches::service |
[releng] |
| 10:47 |
<hashar> |
Cleaning out squid peers list |
[releng] |
| 10:11 |
<hashar> |
made /etc/ a git repository on deployment-squid and committed existing /etc/squid/ |
[releng] |
| 10:03 |
<hashar> |
adding generic::packages::git-core on deployment-squid so we can track |
[releng] |
| 05:35 |
<paravoid> |
powercycled lvs6, was dead and not responding to serial |
[production] |
| 03:43 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'adding db58 to s7 as a new slave with a low weight' |
[production] |
| 03:24 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'pulling db58' |
[production] |
| 03:23 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'adding db58 to s7 as a new slave with a low weight' |
[production] |
| 02:28 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf1) at Wed Apr 25 02:28:47 UTC 2012 |
[production] |
| 02:14 |
<logmsgbot_> |
LocalisationUpdate completed (1.19) at Wed Apr 25 02:14:46 UTC 2012 |
[production] |
| 00:02 |
<binasher> |
profiling collector was pegged at 100% cpu and graphs were turned to swiss cheese due to a bad stats call in 1.20, now fixed |
[production] |
|
2012-04-24
§
|
| 23:59 |
<binasher> |
powering off db16 |
[production] |
| 23:55 |
<binasher> |
streaming hot backup of db1041 to db58 (building a new s7 slave) |
[production] |
| 23:48 |
<logmsgbot_> |
aaron synchronized php-1.19/includes/Setup.php 'Hacked out session request stats.' |
[production] |
| 23:46 |
<logmsgbot_> |
aaron synchronized php-1.20wmf1/includes/Setup.php 'Deployed 42fcd43299246ecd1b265fcfcdd01a60319cf378' |
[production] |
| 23:21 |
<labs-logs-bottie> |
petrb: disabled $wmgEnableCaptcha |
[releng] |
| 23:19 |
<AaronSchulz> |
Running 'mwscriptwikiset maintenance/populateRevisionSha1.php all.dblist' on hume |
[production] |
| 22:43 |
<logmsgbot_> |
aaron synchronized wmf-config/CommonSettings.php 'Enabled file change journal on wikis using the new backend config.' |
[production] |
| 22:20 |
<AaronSchulz> |
Tables added |
[production] |
| 22:18 |
<binasher> |
rebooting db16 with updated kernel. it's probably still hopeless (dimm errors) |
[production] |
| 22:18 |
<AaronSchulz> |
Creating the filejournal table on all wikis |
[production] |
| 21:59 |
<logmsgbot_> |
aaron synchronized wmf-config/CommonSettings.php 'Switched commonswiki to the new backend config format.' |
[production] |
| 21:48 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'pulling db16, memory errors' |
[production] |
| 20:13 |
<apergos> |
re-enabled replication via cron on ms7, it should catch up within an hour or so |
[production] |
| 20:10 |
<binasher> |
reimaged db58 with fixed raid setup, imaging db59 |
[production] |
| 19:51 |
<notpeter> |
starting innobackupex from db1034 to db57 for new s2 slave |
[production] |
| 19:50 |
<Ryan_Lane> |
repooling ssl3001 |
[production] |
| 19:28 |
<Ryan_Lane> |
depooling ssl3001 |
[production] |
| 18:54 |
<hashar> |
wrap -dbdump motd to 80 chars |
[releng] |
| 18:18 |
<LeslieCarr> |
deploying to frontend |
[production] |
| 17:48 |
<notpeter> |
deploying new squid conf to cp1001 frontend. is just a udp2log port change. |
[production] |
| 17:19 |
<logmsgbot_> |
aaron synchronized wmf-config/CommonSettings.php 'Using newer backend for shared repos for testwiki, test2wiki, and mediawikiwiki.' |
[production] |
| 16:55 |
<logmsgbot_> |
nikerabbit synchronized wmf-config/CommonSettings.php 'Translate extension configuration changes' |
[production] |
| 15:42 |
<hashar> |
deployement-web host does work! :-] |
[releng] |
| 15:41 |
<hashar> |
made deployement-web host a wikimedia-task-appserver , add to create some apache2 configuration placeholder. Apache2 does launch but it is not working though (timeout) |
[releng] |
| 15:40 |
<petan|wk> |
I told hashar to log stuff, if he won't, slap him |
[releng] |
| 13:18 |
<hashar> |
added apache::service on deployment-web host |
[releng] |
| 12:18 |
<labs-logs-bottie> |
petrb: moved the log file storage to gluster |
[releng] |
| 12:18 |
<labs-logs-bottie> |
petrb: updated git and commited all changes |
[releng] |
| 11:54 |
<apergos> |
after much cursing and kicking zfs, a manual snapshot replication is running in screen as root on ms7 to ms8, expect it to take at least a day |
[production] |
| 11:44 |
<mark> |
Sending all non-european upload traffic back to pmtpa to prepare for eqiad varnish storage rework |
[production] |
| 08:56 |
<mutante> |
updated blog theme per guillaume (April commits) |
[production] |
| 08:05 |
<apergos> |
temporarily disabled automatic zfs replication from ms7 -> ms8, cleared out space on ms8, catching up by hand |
[production] |
| 04:00 |
<Ryan_Lane> |
powercycling ssl1 |
[production] |
| 02:47 |
<logmsgbot_> |
aaron synchronized php-1.19/extensions/MobileFrontend/MobileFrontend.body.php 'Fixed notice spam.' |
[production] |