|
2017-09-26
§
|
| 13:00 |
<elukey> |
add mw132[7,8] to live traffic (new appservers) - weights will be increased incrementally from 5 to 20 |
[production] |
| 12:44 |
<gehel> |
restarting blazegraph on wdqs1004 / wdqs2001 for heap resive - T175919 |
[production] |
| 12:27 |
<marostegui> |
Drop redundant indexes from s2 - T174509 |
[production] |
| 12:12 |
<marostegui> |
Drop redundant indexes from enwiki on eqiad - T174509 |
[production] |
| 12:03 |
<kartik@tin> |
Finished deploy [cxserver/deploy@aa232ee]: Update cxserver, registry reconstruction (duration: 03m 03s) |
[production] |
| 12:00 |
<kartik@tin> |
Started deploy [cxserver/deploy@aa232ee]: Update cxserver, registry reconstruction |
[production] |
| 11:58 |
<moritzm> |
uploaded prometheus-apache-exporter 0.3-1+deb9u1 to apt.wikimedia.org/stretch-wikimedia |
[production] |
| 11:56 |
<marostegui> |
Drop redundant indexes from enwiki on codfw - T174509 |
[production] |
| 11:49 |
<moritzm> |
uploaded prometheus-hhvm-exporter 0.3.1+deb9u1 to apt.wikimedia.org/stretch-wikimedia |
[production] |
| 11:30 |
<kartik@tin> |
(no justification provided) |
[production] |
| 11:29 |
<kartik@tin> |
Finished deploy [cxserver/deploy@f1d4851]: Update cxserver, registry reconstruction (duration: 00m 52s) |
[production] |
| 11:28 |
<kartik@tin> |
Started deploy [cxserver/deploy@f1d4851]: Update cxserver, registry reconstruction |
[production] |
| 10:52 |
<volans> |
uploaded cumin_1.1.1-1_amd64.deb to apt.wikimedia.org jessie-wikimedia |
[production] |
| 10:34 |
<joal@tin> |
Finished deploy [analytics/refinery@5d806c6]: Regular analytics deploy (duration: 08m 00s) |
[production] |
| 10:26 |
<joal@tin> |
Started deploy [analytics/refinery@5d806c6]: Regular analytics deploy |
[production] |
| 10:20 |
<_joe_> |
rebooting copper (again) |
[production] |
| 09:12 |
<elukey> |
add mw132[4,5,6] to live traffic (new appservers) - weights will be increased incrementally from 5 to 20 |
[production] |
| 09:10 |
<_joe_> |
rebooting copper to verify docker setup is correct |
[production] |
| 08:46 |
<moritzm> |
installing apache updates on mw* app servers |
[production] |
| 08:44 |
<godog> |
run puppet on ms-fe* to reduce conntrack generated by swift internal clients towards backends - T173731 |
[production] |
| 08:24 |
<godog> |
roll-restart thumbor to upgrade to 1.5 - T173804 |
[production] |
| 08:09 |
<godog> |
roll-restart swift-proxy to apply https://gerrit.wikimedia.org/r/#/c/380483/ - T161535 |
[production] |
| 08:08 |
<marostegui> |
Drop old temporary tar.gz files from dbstore1001 to get back some disk space |
[production] |
| 08:07 |
<marostegui> |
Drop table trackbacks from s3 - T175051 |
[production] |
| 07:48 |
<mattflaschen@tin> |
Synchronized wmf-config/CommonSettings-labs.php: RCFilters: Beta Cluster only (duration: 00m 46s) |
[production] |
| 07:46 |
<marostegui> |
Drop trackbacks table from s7 - T175051 |
[production] |
| 07:28 |
<marostegui> |
Drop trackbacks table from s6 - T175051 |
[production] |
| 07:16 |
<moritzm> |
installing perl security updates |
[production] |
| 06:45 |
<_joe_> |
restarting varnish backend on cp3033, throwing 503s |
[production] |
| 06:29 |
<mobrovac@tin> |
Finished deploy [cpjobqueue/deploy@17c3833]: (no justification provided) (duration: 00m 28s) |
[production] |
| 06:28 |
<mobrovac@tin> |
Started deploy [cpjobqueue/deploy@17c3833]: (no justification provided) |
[production] |
| 06:18 |
<marostegui> |
Drop table trackbacks from s4 - T175051 |
[production] |
| 06:06 |
<marostegui> |
Drop table trackbacks from s5 (only exists on dewiki) - T175051 |
[production] |
| 05:48 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2047 - T176573 (duration: 00m 44s) |
[production] |
| 05:15 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Remove old db1055 comments (duration: 00m 46s) |
[production] |
| 02:29 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Sep 26 02:29:31 UTC 2017 (duration 5m 52s) |
[production] |
| 02:23 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.19) (duration: 07m 26s) |
[production] |
|
2017-09-25
§
|
| 23:58 |
<ejegg> |
updated payments-wiki from d2ce6970a761829de86d62919bca8ebd821f41f1 to 6104e3dea7a7051305c7d76f1e913b2410cbfcbf |
[production] |
| 23:15 |
<mutante> |
gerrit2001 reinstalled with stretch, revoked old puppet cert, accepted new puppet cert, initial run that will do base and all the gerrit things at once.. (T168562) |
[production] |
| 22:53 |
<mutante> |
gerrit2001 - PXE booting |
[production] |
| 22:34 |
<mutante> |
gerrit2001 - schedule downtime for reinstall with strech, reboot imminent |
[production] |
| 20:57 |
<hoo> |
Manually pruned the sites and site_identifiers table on hiwikivoyage, than ran populateSitesTable.php. (T173030) |
[production] |
| 20:37 |
<arlolra> |
Updated Parsoid to 4230c27b (T176425, T173029) |
[production] |
| 20:30 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@376faad]: Updating Parsoid to 4230c27b (duration: 16m 52s) |
[production] |
| 20:13 |
<arlolra@tin> |
Started deploy [parsoid/deploy@376faad]: Updating Parsoid to 4230c27b |
[production] |
| 19:58 |
<XioNoX> |
renumbering ams BGP communities - T167840 |
[production] |
| 19:25 |
<robh@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp4021.ulsfo.wmnet |
[production] |
| 19:02 |
<robh> |
cp4021 coming down for memory swap |
[production] |
| 19:02 |
<robh@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp4021.ulsfo.wmnet |
[production] |
| 18:54 |
<MaxSem> |
started populating ip_changes on group2 wikis |
[production] |