2101-2150 of 10000 results (55ms)
2018-02-02 §
09:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1065 - T162807 (duration: 00m 54s) [production]
08:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 - T162807 (duration: 00m 55s) [production]
08:37 <elukey> apt-get install php5-dbg on phab1001 as attempt to have a better gdb output for T182832 [production]
08:35 <ema> cache_upload: repool cp4022 (varnish 5) [production]
08:29 <ema> cache_upload: upgrade cp4022 to varnish 5 [production]
08:23 <marostegui> Stop replication in sync db1089 - db1065 - T162807 [production]
08:23 <moritzm> installing curl security updates on trusty (Debian already updated) [production]
08:21 <ema> cache_upload: repool cp4021 (varnish 5) [production]
08:14 <ema> cache_upload: upgrade cp4021 to varnish 5 [production]
07:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 - T162807 (duration: 00m 55s) [production]
07:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1065 - T162807 (duration: 00m 55s) [production]
07:10 <marostegui> Fixing data drifts on db1065 - T162807 [production]
05:37 <elukey> truncate /var/log/aphlict/aphlict.log to 25G as temp measure to avoid phab1001's root partition to fill up [production]
2018-02-01 §
23:37 <mutante> creating new 100GB virtual disk for ganeti VM meitnerium (T186020) [production]
23:12 <eileen> update civicrm revision changed from 849bba4186 to 71b1e35b99 (deploy civitoken) [production]
22:37 <ejegg> updated payments-wiki from 40145892e7 to 341cb573a1 [production]
21:56 <raita> Removed 2FA from User:Jehochman [production]
21:52 <raita> Removed 2FA from User:Superzerocool (on Mon, Jan 29): https://phabricator.wikimedia.org/T185731 [production]
20:50 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool of db1083 (duration: 00m 55s) [production]
20:41 <jynus> deployed modified query killer to enwiki replicas [production]
20:35 <jynus@tin> Synchronized wmf-config/db-eqiad.php: emergency depool of db1083 (duration: 00m 55s) [production]
19:19 <chasemp> labservices1001:~# logrotate --force /etc/logrotate.conf [production]
19:17 <chasemp> labservices1002:~# logrotate --force /etc/logrotate.conf [production]
19:04 <demon@tin> Pruned MediaWiki: 1.31.0-wmf.16 [keeping static files] (duration: 01m 16s) [production]
19:02 <demon@tin> Pruned MediaWiki: 1.31.0-wmf.15 (duration: 14m 55s) [production]
16:26 <andrewbogott> apt-get install 'designate' on labservices1001 and 1002 — routine upgrade [production]
15:39 <moritzm> upgrading nginx on mw1266-mw1299 (for T164456) [production]
15:27 <moritzm> restarting apache/HHVM on deployment servers to pick up libxml2/curl security updates [production]
15:14 <moritzm> installing curl security updates [production]
14:48 <moritzm> installing tiff security updates [production]
14:44 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool es2019 (duration: 00m 57s) [production]
14:40 <moritzm> restarting nginx on sodium to pick up libxml2 security update [production]
14:34 <moritzm> restarting apache on rutherfordium to pick up libxml2 security update [production]
14:01 <moritzm> restarting nginx on puppetdb hosts to pick up libxml2 security update [production]
13:56 <moritzm> restarting nginx on meitnerium/archiva to pick up libxml2 security update [production]
13:42 <gehel> restarting nginx on wdqs* for upgrade [production]
13:31 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Update db1051 reason for depooling (duration: 00m 56s) [production]
13:23 <akosiaris> force puppet run on all postgres servers for https://gerrit.wikimedia.org/r/407424 [production]
13:20 <jynus> stop and reimage es2019 [production]
13:13 <moritzm> restarting apache on krypton to pick up libxml2 security update [production]
13:13 <gehel> restarting postgresql and nodejs services on maps* [production]
13:09 <gehel> upgrade nging on elastic* [production]
12:54 <moritzm> restarting nginx on debug proxies to pick up libxml2 security update [production]
12:53 <moritzm> restarting apache on hafnium to pick up libxml2 security update [production]
12:06 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool es2018, depool es2019 (duration: 00m 57s) [production]
12:03 <moritzm> restarting squid on URL downloaders to pick up libxml2 security update [production]
11:53 <moritzm> installing libxml2 security updates [production]
10:33 <godog> roll restart thumbor to lower subprocess timeout - T185479 [production]
02:23 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.17) (duration: 05m 53s) [production]
2018-01-31 §
23:56 <mutante> restarting apache on phabricator server, same pattern as described in T182832 [production]