3151-3200 of 10000 results (34ms)
2012-04-25 §
11:22 <hashar> puppet finished migration of web{3,4,5} to apache::service [releng]
11:19 <hashar> changed squid visible name to squid001.beta.wmflabs.org [releng]
11:02 <hashar> migrate web{3,4,5} from webserver::php5 to apaches::service [releng]
10:47 <hashar> Cleaning out squid peers list [releng]
10:11 <hashar> made /etc/ a git repository on deployment-squid and committed existing /etc/squid/ [releng]
10:03 <hashar> adding generic::packages::git-core on deployment-squid so we can track [releng]
05:35 <paravoid> powercycled lvs6, was dead and not responding to serial [production]
03:43 <logmsgbot_> asher synchronized wmf-config/db.php 'adding db58 to s7 as a new slave with a low weight' [production]
03:24 <logmsgbot_> asher synchronized wmf-config/db.php 'pulling db58' [production]
03:23 <logmsgbot_> asher synchronized wmf-config/db.php 'adding db58 to s7 as a new slave with a low weight' [production]
02:28 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Wed Apr 25 02:28:47 UTC 2012 [production]
02:14 <logmsgbot_> LocalisationUpdate completed (1.19) at Wed Apr 25 02:14:46 UTC 2012 [production]
00:02 <binasher> profiling collector was pegged at 100% cpu and graphs were turned to swiss cheese due to a bad stats call in 1.20, now fixed [production]
2012-04-24 §
23:59 <binasher> powering off db16 [production]
23:55 <binasher> streaming hot backup of db1041 to db58 (building a new s7 slave) [production]
23:48 <logmsgbot_> aaron synchronized php-1.19/includes/Setup.php 'Hacked out session request stats.' [production]
23:46 <logmsgbot_> aaron synchronized php-1.20wmf1/includes/Setup.php 'Deployed 42fcd43299246ecd1b265fcfcdd01a60319cf378' [production]
23:21 <labs-logs-bottie> petrb: disabled $wmgEnableCaptcha [releng]
23:19 <AaronSchulz> Running 'mwscriptwikiset maintenance/populateRevisionSha1.php all.dblist' on hume [production]
22:43 <logmsgbot_> aaron synchronized wmf-config/CommonSettings.php 'Enabled file change journal on wikis using the new backend config.' [production]
22:20 <AaronSchulz> Tables added [production]
22:18 <binasher> rebooting db16 with updated kernel. it's probably still hopeless (dimm errors) [production]
22:18 <AaronSchulz> Creating the filejournal table on all wikis [production]
21:59 <logmsgbot_> aaron synchronized wmf-config/CommonSettings.php 'Switched commonswiki to the new backend config format.' [production]
21:48 <logmsgbot_> asher synchronized wmf-config/db.php 'pulling db16, memory errors' [production]
20:13 <apergos> re-enabled replication via cron on ms7, it should catch up within an hour or so [production]
20:10 <binasher> reimaged db58 with fixed raid setup, imaging db59 [production]
19:51 <notpeter> starting innobackupex from db1034 to db57 for new s2 slave [production]
19:50 <Ryan_Lane> repooling ssl3001 [production]
19:28 <Ryan_Lane> depooling ssl3001 [production]
18:54 <hashar> wrap -dbdump motd to 80 chars [releng]
18:18 <LeslieCarr> deploying to frontend [production]
17:48 <notpeter> deploying new squid conf to cp1001 frontend. is just a udp2log port change. [production]
17:19 <logmsgbot_> aaron synchronized wmf-config/CommonSettings.php 'Using newer backend for shared repos for testwiki, test2wiki, and mediawikiwiki.' [production]
16:55 <logmsgbot_> nikerabbit synchronized wmf-config/CommonSettings.php 'Translate extension configuration changes' [production]
15:42 <hashar> deployement-web host does work! :-] [releng]
15:41 <hashar> made deployement-web host a wikimedia-task-appserver , add to create some apache2 configuration placeholder. Apache2 does launch but it is not working though (timeout) [releng]
15:40 <petan|wk> I told hashar to log stuff, if he won't, slap him [releng]
13:18 <hashar> added apache::service on deployment-web host [releng]
12:18 <labs-logs-bottie> petrb: moved the log file storage to gluster [releng]
12:18 <labs-logs-bottie> petrb: updated git and commited all changes [releng]
11:54 <apergos> after much cursing and kicking zfs, a manual snapshot replication is running in screen as root on ms7 to ms8, expect it to take at least a day [production]
11:44 <mark> Sending all non-european upload traffic back to pmtpa to prepare for eqiad varnish storage rework [production]
08:56 <mutante> updated blog theme per guillaume (April commits) [production]
08:05 <apergos> temporarily disabled automatic zfs replication from ms7 -> ms8, cleared out space on ms8, catching up by hand [production]
04:00 <Ryan_Lane> powercycling ssl1 [production]
02:47 <logmsgbot_> aaron synchronized php-1.19/extensions/MobileFrontend/MobileFrontend.body.php 'Fixed notice spam.' [production]
02:45 <logmsgbot_> aaron synchronized php-1.20wmf1/extensions/MobileFrontend/MobileFrontend.body.php 'Fixed notice spam.' [production]
02:37 <logmsgbot_> aaron synchronized wmf-config/CommonSettings.php 'Restructed filerepo a config a bit; nothing changed yet.' [production]
02:28 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Tue Apr 24 02:28:47 UTC 2012 [production]