|
2014-03-25
§
|
| 17:44 |
<mutante> |
ms5 - 1091 days of uptime, but this was the last, shutdown -h now |
[production] |
| 17:32 |
<catrope> |
synchronized php-1.23wmf18/extensions/LocalisationUpdate 'LU rewrite' |
[production] |
| 17:23 |
<mutante> |
salt-keys: removed snapshots1-4, signed palladiums own salt key |
[production] |
| 17:17 |
<hashar> |
Created and validated job that updates Parsoid on the EQIAD beta cluster \\O/ |
[releng] |
| 17:08 |
<RoanKattouw> |
Syncing rebuilt l10ncache for 1.23wmf19, built with new LocalisationUpdate version |
[production] |
| 16:53 |
<awight> |
update tools from 2cfc441a9e5d2de3cc892d0077603579b220ac0e to 400b4f6b0cf69ac0a7f3621f568f1707f5b4aa85 |
[production] |
| 16:26 |
<ottomata> |
restarting hadoop namenodes to bring in new net topology layout |
[production] |
| 16:25 |
<catrope> |
synchronized php-1.23wmf19/extensions/LocalisationUpdate 'Deploy rewrite for 1.23wmf19' |
[production] |
| 16:20 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'New LocalisationUpdate config' |
[production] |
| 16:00 |
<mutante> |
DNS update - removing snapshots |
[production] |
| 15:31 |
<apergos> |
snapshot1-4 in pmtpa powered off, decom :-) |
[production] |
| 09:27 |
<paravoid> |
elevated 503 levels cause seems to be a single spambot with multiple IPs POSTing malformed requests |
[production] |
| 03:09 |
<springle> |
shutting down pc[123] for decom (pmtpa parser cache) |
[production] |
| 02:48 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Mar 25 02:48:08 UTC 2014 (duration 48m 7s) |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed (1.23wmf19) at 2014-03-25 02:19:52+00:00 |
[production] |
| 02:11 |
<LocalisationUpdate> |
completed (1.23wmf18) at 2014-03-25 02:11:10+00:00 |
[production] |
| 00:07 |
<catrope> |
synchronized php-1.23wmf19/extensions/Wikidata/ |
[production] |
| 00:07 |
<catrope> |
synchronized php-1.23wmf19/extensions/VisualEditor |
[production] |
| 00:06 |
<catrope> |
synchronized php-1.23wmf18/extensions/VisualEditor |
[production] |
|
2014-03-24
§
|
| 23:57 |
<mutante> |
ms5 - removed from icinga,puppet,storedconfigs,salt... |
[production] |
| 23:51 |
<ori> |
Switched CentralNotice to GeoIP cookie rather than bits.wm.o/geoiplookup script tags |
[production] |
| 23:43 |
<awight> |
update tools from de586ae4ad03be52da1bb24177ea4bf7cdbd2c94 to 2cfc441a9e5d2de3cc892d0077603579b220ac0e |
[production] |
| 23:26 |
<ori> |
synchronized wmf-config/CommonSettings.php 'I42e9c8c97: CentralNotice: Re-set $wgCentralGeoScriptURL to false' |
[production] |
| 23:25 |
<ori> |
updated /a/common to {{Gerrit|I42e9c8c97}}: CentralNotice: Re-set $wgCentralGeoScriptURL to false |
[production] |
| 23:17 |
<ori> |
synchronized php-1.23wmf19/extensions/Wikidata 'I6ffb304d3: Update Wikidata' |
[production] |
| 23:16 |
<marktraceur> |
Touching all the MMV scripts because they're not getting invalidated or something |
[releng] |
| 23:10 |
<hashar> |
l10n cache got broken due to a PHP fatal error I introduced. It is back up now. Found out via https://integration.wikimedia.org/dashboard/ |
[releng] |
| 23:09 |
<hashar> |
upgraded all pmtpa varnishes, ran puppet on all of them. all set! |
[releng] |
| 22:57 |
<bd808> |
Forced /srv/scap to update to c771a46 across the cluster |
[production] |
| 22:57 |
<hashar> |
restarting deployment-cache-upload04 , apparently stalled\t |
[releng] |
| 22:48 |
<hashar> |
upgrading varnish on all pmtpa caches. |
[releng] |
| 22:47 |
<hashar> |
apt-get upgrade varnish on deployment-cache-bits03 |
[releng] |
| 22:45 |
<marktraceur> |
attempted restart of varnish on betalabs; seems to have failed, trying again |
[releng] |
| 22:42 |
<hashar> |
made marktraceur a project admin and granted sudo rights |
[releng] |
| 22:39 |
<marktraceur> |
Restarting betalabs varnish to workaround https://bugzilla.wikimedia.org/show_bug.cgi?id=63034 |
[releng] |
| 20:07 |
<subbu> |
deployed Parsoid fa03dd20 with deploy repo sha e4d28e7e |
[production] |
| 19:55 |
<mutante> |
DNS update - removing tampa search pools and searchidx2 |
[production] |
| 19:36 |
<mutante> |
shutdown searchidx2 |
[production] |
| 19:23 |
<ottomata> |
stopping hadoop service on analytics1020 and shutting down for move to Row D |
[production] |
| 19:19 |
<mutante> |
searchidx2 - revoked puppet cert,remove from puppet,icinga,salt... |
[production] |
| 19:02 |
<ottomata> |
stopping hadoop services on analytics1019 and shutting it down for move to Row D |
[production] |
| 18:22 |
<springle> |
synchronized wmf-config/db-eqiad.php 's5 db1037 full steam' |
[production] |
| 17:25 |
<bd808> |
Converted deployment-db1.eqiad.wmflabs to use local puppet & salt masters |
[releng] |
| 17:06 |
<bd808> |
Changed rules in sql security group to use CIDR 10.0.0.0/8. |
[releng] |
| 17:05 |
<bd808> |
Changed rules in search security group to use CIDR 10.0.0.0/8. |
[releng] |
| 17:05 |
<bd808> |
Built deployment-elastic04.eqiad.wmflabs with local salt/puppet master, secondary disk on /var/lib/elasticsearch and role::elasticsearch::server |
[releng] |
| 16:19 |
<bd808> |
Built deployment-elastic03.eqiad.wmflabs with local salt/puppet master, secondary disk on /var/lib/elasticsearch and role::elasticsearch::server |
[releng] |
| 16:08 |
<bd808> |
Built deployment-elastic02.eqiad.wmflabs with local salt/puppet master, secondary disk on /var/lib/elasticsearch and role::elasticsearch::server |
[releng] |
| 15:54 |
<bd808> |
Built deployment-elastic01.eqiad.wmflabs with local salt/puppet master, secondary disk on /var/lib/elasticsearch and role::elasticsearch::server |
[releng] |
| 14:31 |
<ottomata> |
stopping hadoop services and shutting down analytics1018 |
[production] |