|
2017-10-20
§
|
| 18:52 |
<bblack> |
vhtcpd upgrade + queue delay puppetization deploy ( https://gerrit.wikimedia.org/r/385415 ) done on cp* fleet - T133821 |
[production] |
| 18:28 |
<bblack> |
upgrading vhtcpd to 0.1.1-1 on the cp* fleet |
[production] |
| 17:38 |
<mutante> |
removing Apache and HHVM Ganglia stats from all appservers, part of retiring Ganglia (T177225) - some transient puppet issues while purging package and remnants - use grafana dashboard at https://grafana.wikimedia.org/dashboard/db/prometheus-apache-hhvm-dc-stats |
[production] |
| 16:39 |
<aaron@tin> |
Synchronized php-1.31.0-wmf.4/extensions/TwoColConflict: 5c3224980fe (duration: 00m 46s) |
[production] |
| 16:37 |
<aaron@tin> |
Synchronized php-1.31.0-wmf.4/extensions/OATHAuth: c16a94e17b9981 (duration: 00m 47s) |
[production] |
| 16:05 |
<krinkle@tin> |
Synchronized php-1.31.0-wmf.4/extensions/WikimediaMaintenance/getJobQueueLengths.php: I8737795e6 (duration: 00m 47s) |
[production] |
| 16:05 |
<XioNoX> |
removing "policy-options policy-statement LVS_import term secondary" on cr routers |
[production] |
| 14:39 |
<cmjohnson1> |
updating power firmware analytics1037 |
[production] |
| 10:14 |
<moritzm> |
upgrading hhvm-wikidiff2 to 1.5.1 on mw2150/mw2151/mw2244/mw2245 |
[production] |
| 09:17 |
<moritzm> |
upgrading hhvm-wikidiff2 to 1.5.1 on mw2200-mw2223 |
[production] |
| 08:05 |
<Amir1> |
mwscript createAndPromote.php --wiki=techconductwiki --sysop --bureaucrat 'Ladsgroup' --force |
[production] |
| 07:39 |
<jynus> |
stopping db2033, too |
[production] |
| 07:36 |
<jynus> |
stopping dbstore1002 and dbstore2002 x1 replication in sync |
[production] |
| 07:18 |
<_joe_> |
uploading updated versions of docker base images (wikimedia-jessie, wikimedia-stretch) to docker-registry.wikimedia.org |
[production] |
| 06:26 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1078 - T164488 (duration: 00m 46s) |
[production] |
| 06:17 |
<marostegui> |
Stop replication in sync on db1103 and db1078 - T164488 |
[production] |
| 06:15 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1078 - T164488 (duration: 00m 45s) |
[production] |
| 06:06 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1072 - T164488 (duration: 00m 46s) |
[production] |
| 05:52 |
<marostegui> |
Stop replication in sync on db1103 and db1072 - T164488 |
[production] |
| 05:41 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1051 - T174509 (duration: 00m 47s) |
[production] |
| 02:19 |
<bblack> |
upgrading vhtcpd to 0.1.1-1 on: cp1008, cp3030, cp3034, cp4029-32 |
[production] |
| 02:17 |
<bblack> |
uploaded vhtcpd-0.1.1-1 to reprepro |
[production] |
|
2017-10-19
§
|
| 22:21 |
<addshore> |
stop running extra change dispatchers on terbium for wikidatawiki |
[production] |
| 21:58 |
<addshore> |
running extra change dispatchers on terbium for wikidatawiki for a short while |
[production] |
| 21:24 |
<andrewbogott> |
restarting nginx on nitrogen |
[production] |
| 21:22 |
<andrewbogott> |
restarting puppetdb on nitrogen |
[production] |
| 20:00 |
<mforns@tin> |
Finished deploy [analytics/refinery@0c9ba04]: deploying refinery to fix banner activity false alarms (duration: 00m 14s) |
[production] |
| 19:59 |
<mforns@tin> |
Started deploy [analytics/refinery@0c9ba04]: deploying refinery to fix banner activity false alarms |
[production] |
| 19:53 |
<bblack> |
reboot cp4029-32 (initial reboot post-puppetization) |
[production] |
| 19:12 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group2 to wmf.4 |
[production] |
| 18:36 |
<thcipriani@tin> |
Synchronized portals: SWAT: [[gerrit:385214|Bumping portals to master]] T128546 (duration: 00m 51s) |
[production] |
| 18:35 |
<thcipriani@tin> |
Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:385214|Bumping portals to master]] T128546 (duration: 00m 50s) |
[production] |
| 18:28 |
<thcipriani@tin> |
Synchronized wmf-config/abusefilter.php: SWAT: [[gerrit:383858|Enable $wgAbuseFilterProfile on ptwiki]] T177641 (duration: 00m 50s) |
[production] |
| 18:20 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.4/extensions/Echo/modules/styles/mw.echo.ui.PageNotificationsOptionWidget.less: SWAT: [[gerrit:385110|mw.echo.ui.PageNotificationsOptionWidget: Fix CSS after changes in OOjs UI]] T178439 (duration: 00m 51s) |
[production] |
| 16:50 |
<hashar> |
contint1001: installed python3 (pending https://gerrit.wikimedia.org/r/385210 ) |
[production] |
| 15:14 |
<marostegui> |
Stop replication in sync on db1103 and db1072 - https://phabricator.wikimedia.org/T164488 |
[production] |
| 15:02 |
<mforns@tin> |
Finished deploy [analytics/refinery@0c9ba04]: (no justification provided) (duration: 00m 07s) |
[production] |
| 15:02 |
<mforns@tin> |
Started deploy [analytics/refinery@0c9ba04]: (no justification provided) |
[production] |
| 14:36 |
<mforns@tin> |
Finished deploy [analytics/refinery@0c9ba04]: (no justification provided) (duration: 03m 29s) |
[production] |
| 14:33 |
<mforns@tin> |
Started deploy [analytics/refinery@0c9ba04]: (no justification provided) |
[production] |
| 13:20 |
<moritzm> |
upgrading mw2120-mw2147 to wikidiff2 1.5.1 |
[production] |
| 12:35 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2034 and db2036 - T178359 (duration: 00m 50s) |
[production] |
| 11:40 |
<akosiaris> |
T177196 upload prometheus-postgres-exporter_0.2.0+ds-2 to apt.wikimedia.org/stretch-wikimedia/main and copied over to apt.wikimedia.org/jessie-wikimedia/main |
[production] |
| 11:10 |
<moritzm> |
upgrading mw1276-mw1279 (canary servers) to wikidiff2 1.5.1 |
[production] |
| 10:14 |
<godog> |
upgrade prometheus-hhvm-exporter to 0.4-1 |
[production] |
| 10:07 |
<mobrovac@tin> |
Started restart [electron-render/deploy@8dd5f13]: Electron hanging - T174916 |
[production] |
| 09:54 |
<ppchelko@tin> |
Finished deploy [restbase/deploy@2001a66]: Enable summary on Cass 3 for all but wikipedia (duration: 07m 32s) |
[production] |
| 09:50 |
<ariel@tin> |
Finished deploy [dumps/dumps@2b9326b]: improved job batches for rev content 7z recompression (duration: 00m 02s) |
[production] |
| 09:50 |
<ariel@tin> |
Started deploy [dumps/dumps@2b9326b]: improved job batches for rev content 7z recompression |
[production] |
| 09:48 |
<moritzm> |
installing pyjwt security updates |
[production] |