|
2019-01-04
§
|
| 23:07 |
<mutante> |
scandium apt-get remove nodejs nodes-legacy ; puppet agent -tv - after merging gerrit:482150 this fixed "you have held broken packages" issue, now we are at a puppet dependecy cycle with apt::pin T201366 |
[production] |
| 15:42 |
<bawolff@deploy1001> |
Synchronized private/PrivateSettings.php: T212667 - More aggressive anti-spam measures for account creation on kowiki (duration: 00m 48s) |
[production] |
| 14:08 |
<moritzm> |
rebooting etcd1001-1003 to pick up SSBD-enabled qemu |
[production] |
| 13:52 |
<moritzm> |
rebooting etcd1004-1006 to pick up SSBD-enabled qemu |
[production] |
| 13:33 |
<moritzm> |
rebooting kubernetes staging etcd hosts to pick up SSBD-enabled qemu |
[production] |
| 13:11 |
<moritzm> |
rebooting kubernetes staging master to pick up SSBD-enabled qemu |
[production] |
| 12:57 |
<moritzm> |
rebooting kubernetes staging workers for kernel security update |
[production] |
| 11:58 |
<moritzm> |
installing libsndfile security updates |
[production] |
| 11:33 |
<moritzm> |
installing jasper security updates |
[production] |
| 11:31 |
<moritzm> |
installing libdatetime-timezone-perl updates for recent tz changes |
[production] |
| 10:47 |
<arturo> |
T212898 reimaging cloudvirt1024 as stretch |
[production] |
| 10:46 |
<moritzm> |
rolling restart of swift proxies to pick up OpenSSL update |
[production] |
| 09:57 |
<jijiki> |
restarting thumbor services to pick up 481141 |
[production] |
| 09:50 |
<onimisionipe> |
restarting nginx on all wdqs hosts |
[production] |
| 09:40 |
<banyek> |
executing schema change on dbstore1002 - T85757 |
[production] |
| 09:13 |
<moritzm> |
restarting nginx on puppetdb hosts to pick up new OpenSSL |
[production] |
| 09:03 |
<banyek> |
executing schema change on db1116 - T85757 |
[production] |
| 08:44 |
<moritzm> |
restarting nginx on francium to pick up new OpenSSL |
[production] |
| 08:16 |
<elukey> |
restart eventlogging daemons on eventlog1002 to pick up openssl updates |
[production] |
| 07:56 |
<moritzm> |
installing OpenSSL security updates |
[production] |
| 00:07 |
<mutante> |
an-coord1001 - apt-get clean to free disk space, reacting to Icinga alert for running out of disk |
[production] |
|
2019-01-03
§
|
| 23:08 |
<volans> |
restarted pdfrender on scb1004 |
[production] |
| 22:29 |
<volans> |
restarted all slaves on dbstore1002 (relayed from banyek) |
[production] |
| 22:14 |
<banyek> |
stopping all slaves on dbstore1002 (NOT labsdb) |
[production] |
| 22:14 |
<banyek> |
stopping all slaves on labsdb1002 |
[production] |
| 20:50 |
<reedy@deploy1001> |
Synchronized multiversion/MWMultiVersion.php: Fix error for testcommons (duration: 00m 44s) |
[production] |
| 20:46 |
<reedy@deploy1001> |
Synchronized dblists/group0.dblist: Add testcommonswiki to group0 (duration: 00m 43s) |
[production] |
| 20:43 |
<reedy@deploy1001> |
Synchronized wmf-config/interwiki.php: Updating interwiki cache (duration: 02m 05s) |
[production] |
| 20:24 |
<reedy@deploy1001> |
Synchronized wmf-config/db-codfw.php: T197616 (duration: 00m 44s) |
[production] |
| 20:23 |
<reedy@deploy1001> |
Synchronized wmf-config/db-eqiad.php: T197616 (duration: 00m 44s) |
[production] |
| 20:13 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T197616 (duration: 00m 44s) |
[production] |
| 20:12 |
<reedy@deploy1001> |
Synchronized multiversion/MWMultiVersion.php: T197616 (duration: 00m 44s) |
[production] |
| 20:11 |
<reedy@deploy1001> |
rebuilt and synchronized wikiversions files: T197616 |
[production] |
| 20:09 |
<reedy@deploy1001> |
Synchronized dblists/: T197616 (duration: 00m 45s) |
[production] |
| 18:51 |
<bsitzmann@deploy1001> |
Finished deploy [mobileapps/deploy@1182b3b]: Update mobileapps to f6ad0e5: Set timeout for backend /page/html requests, part 2 (duration: 05m 27s) |
[production] |
| 18:46 |
<bsitzmann@deploy1001> |
Started deploy [mobileapps/deploy@1182b3b]: Update mobileapps to f6ad0e5: Set timeout for backend /page/html requests, part 2 |
[production] |
| 18:37 |
<bsitzmann@deploy1001> |
Finished deploy [mobileapps/deploy@c470ed2]: Update mobileapps to f6ad0e5: Set timeout for backend /page/html requests (duration: 04m 11s) |
[production] |
| 18:33 |
<bsitzmann@deploy1001> |
Started deploy [mobileapps/deploy@c470ed2]: Update mobileapps to f6ad0e5: Set timeout for backend /page/html requests |
[production] |
| 18:21 |
<volans> |
restart pdfrender on scb1003 |
[production] |
| 17:58 |
<ariel@deploy1001> |
Finished deploy [dumps/dumps@10dc8ad]: return properly if commands failed (duration: 00m 08s) |
[production] |
| 17:58 |
<ariel@deploy1001> |
Started deploy [dumps/dumps@10dc8ad]: return properly if commands failed |
[production] |
| 16:32 |
<XioNoX> |
remove old 10.64.22.0/24 IPs from cloud-instance-transport1-b-eqiad - T207663 |
[production] |
| 16:22 |
<moritzm> |
rebooting kubernetes workers in eqiad for kernel security update |
[production] |
| 16:02 |
<arturo> |
reimaging cloudvirt1013 cloudvirt1026-1028 to stretch |
[production] |
| 15:48 |
<moritzm> |
restart parsoid on wtp1025 to pick up OpenSSL update for nodejs |
[production] |
| 15:43 |
<jijiki> |
Enabled puppet on mw servers after merging 481796 - T197616 |
[production] |
| 15:31 |
<jijiki> |
Disabling puppet on mw servers to test 481796 - T197616 |
[production] |
| 15:14 |
<ejegg> |
updated Fundraising CiviCRM from b33dcd3c94 to bcb4b7a7d1 |
[production] |
| 14:37 |
<moritzm> |
rebooting kubernetes workers in codfw for kernel security update |
[production] |
| 14:37 |
<banyek@deploy1001> |
Synchronized wmf-config/db-eqiad.php: repool db1101:3317 after schema change - T85757 (duration: 00m 44s) |
[production] |