2018-10-18
§
|
09:08 |
<moritzm> |
powercycling ms-be2019, stuck during reboot |
[production] |
09:01 |
<banyek> |
enabling replication monitor check on pc1004 (T206992) |
[production] |
08:56 |
<banyek> |
enabling replication monitor check on pc2004 (T206992) |
[production] |
08:41 |
<banyek> |
disabling puppet on parser caches (T206992) |
[production] |
08:40 |
<banyek> |
adding replication monitoring checks to parsercache hosts (T206992) |
[production] |
08:26 |
<vgutierrez> |
Uploaded certcentral 0.1-2 to apt.wikimedia.org (stretch) |
[production] |
07:56 |
<moritzm> |
rebooting swift backend servers in codfw for spectre v3/v4/L1TF security updates |
[production] |
07:43 |
<addshore@deploy1001> |
Synchronized wmf-config/Wikibase.php: Wikidata dispatch: reduce concurrent dispatchers to 2 (duration: 00m 59s) |
[production] |
05:34 |
<marostegui> |
Restarting a failed s8 backup from dbstore1001 to db1116:3318 |
[production] |
05:05 |
<XioNoX> |
start office-DC link renumbering - T205985 |
[production] |
02:51 |
<ejegg> |
updated fundraising CiviCRM from 7b8d33bb4e to 83874e75ba |
[production] |
00:32 |
<twentyafterfour> |
restarting apache on phab1001 to apply b3bfff1138d1212b318392b5e18ac0bfd6f78108 |
[production] |
2018-10-17
§
|
22:56 |
<awight> |
Restarting ORES uwsgi service for T88997 |
[production] |
22:38 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.32.0-wmf.26 refs T191072 |
[production] |
22:36 |
<robh> |
bast4001 reboot is my fault, power cables were justled when i was decommssioning lvs4002 right above it in the rack |
[production] |
22:31 |
<ejegg> |
updated fundraising CiviCRM from 5eac0634e6 to 7b8d33bb4e |
[production] |
22:24 |
<ejegg> |
updated payments-wiki from 0385ad02a7 to a3892e4ed3 |
[production] |
22:21 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@88c8f26] (dev-cluster): Spread requests beetween MCS nodes for onthisday (duration: 02m 54s) |
[production] |
22:18 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@88c8f26] (dev-cluster): Spread requests beetween MCS nodes for onthisday |
[production] |
20:50 |
<arlolra> |
Updated Parsoid to e6b708b (T204622, T187848, T207093) |
[production] |
20:40 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@babf1da]: Updating Parsoid to e6b708b (duration: 08m 41s) |
[production] |
20:32 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@babf1da]: Updating Parsoid to e6b708b |
[production] |
20:17 |
<mobrovac@deploy1001> |
Started restart [proton/deploy@a657059]: (no justification provided) |
[production] |
20:10 |
<ejegg> |
updated fundraising CiviCRM from 4cc21d61c5 to 5eac0634e6 |
[production] |
19:26 |
<shdubsh> |
restart eventlogging for statsd DNS change - T88997 |
[production] |
19:23 |
<twentyafterfour> |
Mediawiki train is still blocked by T207288 |
[production] |
19:19 |
<godog> |
restart zuul for statsd DNS change - T88997 |
[production] |
19:12 |
<mutante> |
scb1003 - restart pdfrender |
[production] |
19:09 |
<godog> |
roll-restart eventbus for statsd DNS change - T88997 |
[production] |
19:00 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.26/includes/cache/: T193271 - I25aa0e27200a0 (duration: 01m 01s) |
[production] |
18:57 |
<awight> |
Restarting ORES cluster to refresh DNS, T88997 |
[production] |
18:48 |
<banyek> |
repooling labsdb1009 (T181650) |
[production] |
18:48 |
<shdubsh> |
restart navtiming on webperf nodes |
[production] |
18:39 |
<godog> |
restart jmxtrans on kafka hosts |
[production] |
18:17 |
<shdubsh> |
moving statsd cname to graphite1004 |
[production] |
18:07 |
<banyek> |
depooling labsdb1009 (T181650) |
[production] |
17:08 |
<banyek> |
depooling labsdb1009 (T181650) |
[production] |
16:53 |
<banyek> |
repooling labsdb1011 |
[production] |
15:53 |
<twentyafterfour@deploy1001> |
Synchronized php-1.32.0-wmf.26/extensions/AbuseFilter/: sync AbuseFilter revision 4e2a6b665825e0850138487ee395a3f55f3dec96 to 1.32.0-wmf.26 refs T207220 (duration: 00m 58s) |
[production] |
15:34 |
<banyek@deploy1001> |
Synchronized wmf-config/db-codfw.php: T206593: Enabling db2096 for x1 (duration: 00m 56s) |
[production] |
15:30 |
<banyek@deploy1001> |
Synchronized wmf-config/db-codfw.php: T206593: Enabling db2096 for x1 (duration: 00m 56s) |
[production] |
15:28 |
<banyek> |
enabling db2096 for cluster x1 (T206593) |
[production] |
14:33 |
<godog> |
upload prometheus-statsd-exporter 0.7.0+ds1-2 - T205870 |
[production] |
14:01 |
<marostegui> |
Repool labsdb1010, depool labsdb1011 - T181650 |
[production] |
13:08 |
<gehel> |
applying rps NIC config for all wdqs nodes - T206105 |
[production] |
13:05 |
<banyek> |
deplooling labsdb1010 (T181650) |
[production] |
12:56 |
<banyek> |
enabling notifications on db2096 (T206593) |
[production] |
12:55 |
<banyek> |
enabling notifications on db2096 |
[production] |
11:40 |
<Amir1> |
EU SWAT is done |
[production] |
11:40 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:467946|Enable reading from new backend of change tag everywhere (T194164)]] (duration: 00m 57s) |
[production] |