|
2012-04-25
§
|
| 22:14 |
<LeslieCarr> |
restarted swift-container-auditor on ms-be3 |
[production] |
| 21:55 |
<RobH> |
pushing dns update for scs-c1-eqiad and ps1-c#-eqiad |
[production] |
| 21:22 |
<LeslieCarr> |
reloading varnish on mobile caches cp1041 cp1042 cp1043 cp1044 |
[production] |
| 21:21 |
<LeslieCarr> |
clearing mobile varnish cache |
[production] |
| 19:38 |
<logmsgbot_> |
catrope synchronized php-1.20wmf1/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'Attempted fatal fix' |
[production] |
| 19:33 |
<logmsgbot_> |
catrope synchronized php-1.20wmf1/extensions/Math/ 'Deploying 4c9e7dbe761c798ce15d7e2acef829a1582c058b' |
[production] |
| 19:14 |
<notpeter> |
starting innobackupex from db12 to db59 for new s1 slave, per mr. feldman's directions |
[production] |
| 18:56 |
<notpeter> |
starting innobackupex from db1017 to db60 for new s1 slave |
[production] |
| 18:49 |
<logmsgbot_> |
aaron synchronized php-1.20wmf1/extensions/FeaturedFeeds/SpecialFeedItem.php 'Deployed 4fb14a7b2ca9be715b820a9847d999f21c7d2cfc' |
[production] |
| 18:36 |
<logmsgbot_> |
aaron synchronized php-1.20wmf1/img_auth.php 'Deployed f7e49bd71bd8356751242c5ce1cbae076a27cf7a' |
[production] |
| 18:10 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: Moving all remaining wikis to php-1.20wmf1 |
[production] |
| 17:07 |
<LeslieCarr> |
reloaded mobile varnish configs |
[production] |
| 17:06 |
<LeslieCarr> |
purging mobile cache |
[production] |
| 17:01 |
<labs-logs-bottie> |
j: Changing uid and group of apache user from 48 to 33 to match www-data on web3,web4,web5 |
[releng] |
| 16:44 |
<Platonides> |
With the uid change to deployment-web, it is now writing into /data/project/errors.log |
[releng] |
| 16:43 |
<hashar> |
Apaches no more log anything. This is because rsyslog sends logs to a blackhole :-D |
[releng] |
| 16:40 |
<LeslieCarr> |
starting delete script on ms-be3 |
[production] |
| 16:27 |
<Platonides> |
Changing uid and group of apache user from 48 to 33 to match www-data |
[releng] |
| 16:14 |
<RobH> |
done moving mgmt connections and serial connections in s8-eqiad for now |
[production] |
| 16:05 |
<RobH> |
reshuffling cables in eqiad for serial and mgmt connections in a8, this may affect all eqiad mgmt and serial connections for the next 5 minutes |
[production] |
| 15:29 |
<hashar> |
hashar: gallium: MySQL had issues most probably because of the mysql configuration snippets. https://gerrit.wikimedia.org/r/5796 might solve that. |
[production] |
| 15:20 |
<hashar> |
deleting testswarmmysqlconf , it is of no use :-/ |
[releng] |
| 14:43 |
<hashar> |
Creating temporary instance to test a MySQL puppet snippet |
[releng] |
| 14:03 |
<mutante> |
gallium - don't start puppet unless the erb template fix for mysql has been merged |
[production] |
| 13:52 |
<mutante> |
gallium stopped puppet, moved log_slow_queries config, re-setting up mysql again |
[production] |
| 13:41 |
<mutante> |
gallium/testswarm - back up after mysql upgrade and issue starting the service |
[production] |
| 13:36 |
<mutante> |
gallium - dpkg-reconfigure mysql-server-5.1, mysql does not start right |
[production] |
| 13:27 |
<mutante> |
running apt-get upgrade on gallium |
[production] |
| 13:01 |
<labs-logs-bottie> |
hashar: I am a hero |
[releng] |
| 13:00 |
<labs-logs-bottie> |
petrb: test |
[releng] |
| 12:29 |
<mark> |
Sending US, Brazil, Indian traffic to upload.eqiad |
[production] |
| 12:24 |
<hashar> |
added a basic puppet skeleton in manifests/labs/beta/ with https://gerrit.wikimedia.org/r/5790 (test branch) |
[releng] |
| 11:39 |
<mutante> |
running authdns-update to add analysis mgmt names |
[production] |
| 11:39 |
<hashar> |
manually purged debian package `ack`, installed `ack-grep` |
[releng] |
| 11:22 |
<hashar> |
puppet finished migration of web{3,4,5} to apache::service |
[releng] |
| 11:19 |
<hashar> |
changed squid visible name to squid001.beta.wmflabs.org |
[releng] |
| 11:02 |
<hashar> |
migrate web{3,4,5} from webserver::php5 to apaches::service |
[releng] |
| 10:47 |
<hashar> |
Cleaning out squid peers list |
[releng] |
| 10:11 |
<hashar> |
made /etc/ a git repository on deployment-squid and committed existing /etc/squid/ |
[releng] |
| 10:03 |
<hashar> |
adding generic::packages::git-core on deployment-squid so we can track |
[releng] |
| 05:35 |
<paravoid> |
powercycled lvs6, was dead and not responding to serial |
[production] |
| 03:43 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'adding db58 to s7 as a new slave with a low weight' |
[production] |
| 03:24 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'pulling db58' |
[production] |
| 03:23 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'adding db58 to s7 as a new slave with a low weight' |
[production] |
| 02:28 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf1) at Wed Apr 25 02:28:47 UTC 2012 |
[production] |
| 02:14 |
<logmsgbot_> |
LocalisationUpdate completed (1.19) at Wed Apr 25 02:14:46 UTC 2012 |
[production] |
| 00:02 |
<binasher> |
profiling collector was pegged at 100% cpu and graphs were turned to swiss cheese due to a bad stats call in 1.20, now fixed |
[production] |