|
2013-06-07
§
|
| 23:08 |
<RoanKattouw> |
Restarted Apache on gallium agai |
[production] |
| 22:46 |
<gwicke> |
update Parsoid to 9ccf7a3365 |
[production] |
| 22:45 |
<RoanKattouw> |
and on cerium and titanium too |
[production] |
| 22:45 |
<RoanKattouw> |
Rerunning puppet on nickel for parsoidcache change |
[production] |
| 22:39 |
<LeslieCarr> |
restart snmptrapd and smptt on neon |
[production] |
| 22:23 |
<gwicke> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 22:02 |
<gwicke> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 21:57 |
<reedy> |
synchronized php-1.22wmf6/extensions/EducationProgram/ |
[production] |
| 21:56 |
<reedy> |
synchronized php-1.22wmf5/extensions/EducationProgram/ |
[production] |
| 21:48 |
<demon> |
synchronized wmf-config/CommonSettings.php 'Enable REL1_21 for extdist' |
[production] |
| 21:45 |
<cmjohnson1> |
auth-dns update |
[production] |
| 21:20 |
<mutante> |
installing package upgrades on neon now that it has inodes again |
[production] |
| 21:07 |
<cmjohnson1> |
auth-dns update removing tampa parsoid dns entries |
[production] |
| 21:05 |
<mutante> |
neon ran out of inodes, culprit /var/spool/snmptt has >300k files, deleting -mtime +2 in batches |
[production] |
| 20:48 |
<RoanKattouw> |
Actually restarting pybal on lvs4 now |
[production] |
| 20:48 |
<RoanKattouw> |
Running puppet on lvs4 |
[production] |
| 20:46 |
<RoanKattouw> |
Restarting pybal on lvs4 |
[production] |
| 20:32 |
<RoanKattouw> |
Restarting pybal on lvs3 |
[production] |
| 19:49 |
<aaron> |
synchronized wmf-config/jobqueue-eqiad.php 'Tweaked redis queue timeout and enabled gzip' |
[production] |
| 19:42 |
<RoanKattouw> |
Restarting Parsoid manually because git-deploy is not cooperating |
[production] |
| 19:29 |
<mutante> |
installing package upgrades on neon (Icinga, nagios-plugins) |
[production] |
| 19:27 |
<mutante> |
installing package upgrades on bast1001 |
[production] |
| 19:23 |
<mutante> |
installing package upgrades on fenari |
[production] |
| 19:20 |
<RoanKattouw> |
Restarted Apache on gallium (APC cache pollution) |
[production] |
| 19:12 |
<cmjohnson1> |
shutting down wtp1001 and wtp1002 to relocate to c8-eqiad |
[production] |
| 19:05 |
<RoanKattouw> |
Depooled wtp1008 for investigation, Chris saw some sort of error on it |
[production] |
| 19:03 |
<RoanKattouw> |
Depooled wtp1001, wtp1002 so Chris can move them |
[production] |
| 18:51 |
<cmjohnson1> |
restarting ns1 |
[production] |
| 18:47 |
<cmjohnson1> |
auth-dns update (removing/renaming db1013) |
[production] |
| 18:27 |
<mutante> |
DNS update - removing singer |
[production] |
| 17:51 |
<cmjohnson1> |
shutting down db1013 to move to frack and rename |
[production] |
| 17:44 |
<aaron> |
synchronized php-1.22wmf5/maintenance/eraseArchivedFile.php '2aa62f6afbd48a3362b78788b81aed847e6e805f' |
[production] |
| 16:28 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 16:21 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 16:03 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 15:58 |
<Reedy> |
Created EducationProgram tables on hewiki |
[production] |
| 15:57 |
<Reedy> |
Created EducationProgram tables on sewiki |
[production] |
| 15:55 |
<Reedy> |
Creating wikilove tables on viwiki |
[production] |
| 14:17 |
<hashar> |
Zuul was no more triggering Jenkins jobs {{bug|49294}} . Fixed by Chad who restarted Gerrit. |
[production] |
| 13:54 |
<^demon> |
restarting gerrit, queue is overloaded and it's killing the bridge to jenkins |
[production] |
| 13:43 |
<^demon> |
restarting zuul per https://bugzilla.wikimedia.org/show_bug.cgi?id=49294#c4 |
[production] |
| 12:45 |
<reedy> |
synchronized php-1.22wmf6/extensions/Parsoid/ |
[production] |
| 12:44 |
<reedy> |
synchronized php-1.22wmf5/extensions/Parsoid/ |
[production] |