2018-02-02
§
|
09:13 |
<ema> |
cache_upload: repool cp4023 (varnish 5) |
[production] |
09:08 |
<ema> |
cache_upload: upgrade cp4023 to varnish 5 |
[production] |
09:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1065 - T162807 (duration: 00m 54s) |
[production] |
08:43 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 00m 55s) |
[production] |
08:37 |
<elukey> |
apt-get install php5-dbg on phab1001 as attempt to have a better gdb output for T182832 |
[production] |
08:35 |
<ema> |
cache_upload: repool cp4022 (varnish 5) |
[production] |
08:29 |
<ema> |
cache_upload: upgrade cp4022 to varnish 5 |
[production] |
08:23 |
<marostegui> |
Stop replication in sync db1089 - db1065 - T162807 |
[production] |
08:23 |
<moritzm> |
installing curl security updates on trusty (Debian already updated) |
[production] |
08:21 |
<ema> |
cache_upload: repool cp4021 (varnish 5) |
[production] |
08:14 |
<ema> |
cache_upload: upgrade cp4021 to varnish 5 |
[production] |
07:39 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1089 - T162807 (duration: 00m 55s) |
[production] |
07:11 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1065 - T162807 (duration: 00m 55s) |
[production] |
07:10 |
<marostegui> |
Fixing data drifts on db1065 - T162807 |
[production] |
05:37 |
<elukey> |
truncate /var/log/aphlict/aphlict.log to 25G as temp measure to avoid phab1001's root partition to fill up |
[production] |
2018-02-01
§
|
23:37 |
<mutante> |
creating new 100GB virtual disk for ganeti VM meitnerium (T186020) |
[production] |
23:12 |
<eileen> |
update civicrm revision changed from 849bba4186 to 71b1e35b99 (deploy civitoken) |
[production] |
22:37 |
<ejegg> |
updated payments-wiki from 40145892e7 to 341cb573a1 |
[production] |
21:56 |
<raita> |
Removed 2FA from User:Jehochman |
[production] |
21:52 |
<raita> |
Removed 2FA from User:Superzerocool (on Mon, Jan 29): https://phabricator.wikimedia.org/T185731 |
[production] |
20:50 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool of db1083 (duration: 00m 55s) |
[production] |
20:41 |
<jynus> |
deployed modified query killer to enwiki replicas |
[production] |
20:35 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: emergency depool of db1083 (duration: 00m 55s) |
[production] |
19:19 |
<chasemp> |
labservices1001:~# logrotate --force /etc/logrotate.conf |
[production] |
19:17 |
<chasemp> |
labservices1002:~# logrotate --force /etc/logrotate.conf |
[production] |
19:04 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.16 [keeping static files] (duration: 01m 16s) |
[production] |
19:02 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.15 (duration: 14m 55s) |
[production] |
16:26 |
<andrewbogott> |
apt-get install 'designate' on labservices1001 and 1002 — routine upgrade |
[production] |
15:39 |
<moritzm> |
upgrading nginx on mw1266-mw1299 (for T164456) |
[production] |
15:27 |
<moritzm> |
restarting apache/HHVM on deployment servers to pick up libxml2/curl security updates |
[production] |
15:14 |
<moritzm> |
installing curl security updates |
[production] |
14:48 |
<moritzm> |
installing tiff security updates |
[production] |
14:44 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool es2019 (duration: 00m 57s) |
[production] |
14:40 |
<moritzm> |
restarting nginx on sodium to pick up libxml2 security update |
[production] |
14:34 |
<moritzm> |
restarting apache on rutherfordium to pick up libxml2 security update |
[production] |
14:01 |
<moritzm> |
restarting nginx on puppetdb hosts to pick up libxml2 security update |
[production] |
13:56 |
<moritzm> |
restarting nginx on meitnerium/archiva to pick up libxml2 security update |
[production] |
13:42 |
<gehel> |
restarting nginx on wdqs* for upgrade |
[production] |
13:31 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Update db1051 reason for depooling (duration: 00m 56s) |
[production] |
13:23 |
<akosiaris> |
force puppet run on all postgres servers for https://gerrit.wikimedia.org/r/407424 |
[production] |
13:20 |
<jynus> |
stop and reimage es2019 |
[production] |
13:13 |
<moritzm> |
restarting apache on krypton to pick up libxml2 security update |
[production] |
13:13 |
<gehel> |
restarting postgresql and nodejs services on maps* |
[production] |
13:09 |
<gehel> |
upgrade nging on elastic* |
[production] |
12:54 |
<moritzm> |
restarting nginx on debug proxies to pick up libxml2 security update |
[production] |
12:53 |
<moritzm> |
restarting apache on hafnium to pick up libxml2 security update |
[production] |
12:06 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool es2018, depool es2019 (duration: 00m 57s) |
[production] |
12:03 |
<moritzm> |
restarting squid on URL downloaders to pick up libxml2 security update |
[production] |
11:53 |
<moritzm> |
installing libxml2 security updates |
[production] |
10:33 |
<godog> |
roll restart thumbor to lower subprocess timeout - T185479 |
[production] |