|
2014-05-06
§
|
| 19:00 |
<mutante> |
enabling puppet on netmon1001 |
[production] |
| 17:39 |
<hoo> |
Changed email for global account "ElphiBot". |
[production] |
| 16:49 |
<mattflaschen> |
synchronized php-1.24wmf3/extensions/GettingStarted/ 'GettingStarted token and logging deployment' |
[production] |
| 16:45 |
<mattflaschen> |
synchronized php-1.24wmf2/extensions/GettingStarted/ 'GettingStarted token and logging deployment' |
[production] |
| 16:19 |
<hoo> |
Changed email for global account "Elph". |
[production] |
| 15:42 |
<akosiaris> |
killed zuul processes on gallium and restarted the service |
[production] |
| 09:16 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue May 6 09:15:20 UTC 2014 |
[production] |
| 09:08 |
<LocalisationUpdate> |
completed (1.22wmf15) at Tue May 6 09:07:45 UTC 2014 |
[production] |
| 09:01 |
<faidon> |
synchronized wmf-config/squid.php 'add Swift to squid.php' |
[production] |
| 08:59 |
<faidon> |
updated /a/common to {{Gerrit|Ica9086dcd}}: Add Swift frontends to squid.php |
[production] |
| 08:45 |
<ottomata> |
re-enabling puppet agent on analytics1022; kafka broker is caught up there and is fully in all ISRs |
[production] |
| 08:36 |
<ottomata> |
temporarily disabling puppet on analytics1026 to troubleshoot a camus import problem |
[production] |
| 06:55 |
<springle> |
hammering dbstore1001 with dumps in screen session. ignore replag |
[production] |
| 06:31 |
<ori> |
..on vanadium |
[production] |
| 06:31 |
<ori> |
deleting rotated logs in /var/log/eventlogging/archive that are older than 90 days |
[production] |
| 04:47 |
<springle> |
mydumper/myloader clone db1042 to db1049 |
[production] |
| 04:07 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1049 for maintenance' |
[production] |
| 03:48 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue May 6 03:47:41 UTC 2014 (duration 47m 40s) |
[production] |
| 03:03 |
<LocalisationUpdate> |
completed (1.24wmf3) at 2014-05-06 03:02:03+00:00 |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.24wmf2) at 2014-05-06 02:27:21+00:00 |
[production] |
| 00:02 |
<ori> |
synchronized wmf-config/CommonSettings.php 'Update wgFlowCacheVersion to 4.2' |
[production] |
|
2014-05-05
§
|
| 23:57 |
<ori> |
updated /a/common to {{Gerrit|Id1f2e0acf}}: Drop wgFlowCacheKey from CommonSettings.php |
[production] |
| 23:54 |
<ori> |
Finished scap: SWAT deploy for VisualEditor and Flow cherry-picks (duration: 09m 55s) |
[production] |
| 23:44 |
<ori> |
Started scap: SWAT deploy for VisualEditor and Flow cherry-picks |
[production] |
| 23:26 |
<ori> |
synchronized php-1.24wmf3/extensions/EventLogging 'Update EventLogging for Id23b37fbe for SWAT.' |
[production] |
| 23:23 |
<ori> |
synchronized php-1.24wmf2/extensions/EventLogging 'Update EventLogging for Id23b37fbe for SWAT.' |
[production] |
| 21:07 |
<jgage> |
trying on analytics1022: https://wikitech.wikimedia.org/wiki/Analytics/Kraken/Kafka/Administration#Recovering_a_laggy_broker_replica |
[production] |
| 20:58 |
<RobH> |
ssl1001-1003 now have updated unified cert in service |
[production] |
| 20:58 |
<jgage> |
both kafka brokers back in service |
[production] |
| 20:54 |
<RobH> |
cp4001-4020 unified cert and nginx service reloaded, back in service |
[production] |
| 20:50 |
<RobH> |
ssl1006 and ssl1009 are responsive to nginx and back in service |
[production] |
| 20:43 |
<RobH> |
pybal |
[production] |
| 20:43 |
<RobH> |
ssl1009 was refusing connections both before and after my ssl cert update. ssl1006 is presently refusing connections post update. they are set to disabled in pubal |
[production] |
| 20:40 |
<RobH> |
ssl1008 back into service, ssl1009 already depooled |
[production] |
| 20:38 |
<jgage> |
forced kafka broker reelection |
[production] |
| 20:34 |
<RobH> |
ssl1007 going back into service, ssl1008 depooling |
[production] |
| 20:25 |
<RobH> |
depooled ssl1006/7 for update |
[production] |
| 20:25 |
<RobH> |
ssl1004/5 returned to service (and puppet agents enabled) |
[production] |
| 20:21 |
<RobH> |
puppet agent has been re-enabled on ssl1001-1003 |
[production] |
| 20:20 |
<RobH> |
ssl1004/5 disabled for update |
[production] |
| 20:18 |
<RobH> |
putting ssl1002/3 back into service |
[production] |
| 20:15 |
<subbu> |
deployed parsoid f2f1f1d7 (with deploy sha 71072f8a) |
[production] |
| 19:58 |
<RobH> |
ssl1001 back in service, ssl1002-1003 set to disabled in pybal |
[production] |
| 19:18 |
<RobH> |
depooling ssl1001 to test new certs live on system |
[production] |
| 19:09 |
<RobH> |
disabled puppet on cp40XX, ssl10XX, and ssl30XX |
[production] |
| 19:08 |
<bblack> |
synchronized wmf-config/squid.php 'REVERT: Update wgSquidServersNoPurge to use whole subnets for XFF checking' |
[production] |
| 19:07 |
<bblack> |
updated /a/common to {{Gerrit|Iaf4d57d54}}: Revert "Use whole subnets in squid.php list for XFF acceptance" |
[production] |
| 19:03 |
<bblack> |
synchronized wmf-config/squid.php 'Update wgSquidServersNoPurge to use whole subnets for XFF checking' |
[production] |
| 19:01 |
<bblack> |
updated /a/common to {{Gerrit|I5a2d86ef0}}: Use whole subnets in squid.php list for XFF acceptance |
[production] |
| 17:05 |
<aaron> |
synchronized wmf-config/CommonSettings.php 'Revert "Increased htmlCacheUpdate throttle"' |
[production] |