5201-5250 of 10000 results (61ms)
2018-01-31 §
16:15 <robh> depooling ulsfo for https://phabricator.wikimedia.org/T185228 [production]
15:44 <akosiaris> reimage ores100{1..9} T171851 [production]
14:37 <godog> bump prometheus global instance retention to 15 months - T160677 [production]
12:25 <marostegui> Fix replication on labsdb1004 [production]
09:32 <moritzm> rolling restart of thumbor/nginx to pick up libxml security update [production]
08:21 <moritzm> installing clamav security update on fermium [production]
07:55 <moritzm> installing libxml security updates [production]
07:48 <marostegui> Stop MySQL on db1030 - T184397 [production]
07:47 <marostegui> Remove db1030 from tendril - T184397 [production]
07:13 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Remove db1030, will be decommissioned - T184397 (duration: 00m 56s) [production]
07:10 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db1030, will be decommissioned - T184397 (duration: 00m 57s) [production]
07:08 <marostegui> Force BBU relearn on db1051 - T186049 [production]
06:19 <elukey> restart varnish backend on cp4024 - failed fetches / 503s [production]
02:23 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.17) (duration: 05m 46s) [production]
01:51 <mutante> catchpoint: recycled gwicke's user and turned it into a user for volans, upgraded him to admin (T162857) [production]
00:55 <krinkle@tin> Synchronized wmf-config: no-op, adding files for beta cluster (duration: 00m 59s) [production]
00:51 <krinkle@tin> Synchronized wmf-config/profiler.php: no-op (comment-only) (duration: 00m 58s) [production]
2018-01-30 §
21:39 <demon@tin> Synchronized docroot/noc/conf/open.dblist: (no justification provided) (duration: 00m 57s) [production]
21:38 <demon@tin> Synchronized dblists/open.dblist: Adding open.dblist (duration: 00m 57s) [production]
19:37 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1051 (duration: 00m 57s) [production]
18:32 <mutante> powercyling amslvs4, to be reinstalled as bast3003 [production]
18:08 <moritzm> installing PHP security updates [production]
15:52 <moritzm> installing libxml2 security updates [production]
15:35 <moritzm> installing libxcursor security updates [production]
15:30 <jynus> stop and reimage es2018 [production]
14:42 <moritzm> installing curl security updates on app server canaries along with HHVM restart [production]
13:15 <moritzm> installing rsync security updates on trusty [production]
12:15 <moritzm> installing libxtst updates [production]
10:57 <moritzm> installing ffmpeg security updates [production]
09:34 <moritzm> installing wireshark security updates [production]
08:35 <moritzm> installing libxml2 security updates [production]
02:23 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.17) (duration: 05m 58s) [production]
00:31 <demon@tin> rebuilt and synchronized wikiversions files: not changing versions, testing something [production]
2018-01-29 §
21:33 <arlolra> Updated Parsoid to 91854ff (T185643, T185346, T185385, T185267) [production]
21:23 <arlolra@tin> Finished deploy [parsoid/deploy@cc1574b]: Updating Parsoid to 91854ff (duration: 08m 23s) [production]
21:14 <arlolra@tin> Started deploy [parsoid/deploy@cc1574b]: Updating Parsoid to 91854ff [production]
20:25 <_joe_> repooling mw1275, taking samples of apc metadata at intervals [production]
20:19 <_joe_> depooling mw1275 to take an APC dump [production]
20:15 <niharika29@tin> Synchronized docroot/noc/conf/: Sync removed dblist in https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 56s) [production]
20:13 <niharika29@tin> Synchronized dblists/: Sync removed dblist in https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 56s) [production]
19:58 <niharika29@tin> Synchronized wmf-config/CommonSettings.php: Revert upload rights patch https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 55s) [production]
19:57 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: Revert upload rights patch https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 56s) [production]
19:51 <niharika29@tin> Synchronized php-1.31.0-wmf.17/extensions/Flow/: https://gerrit.wikimedia.org/r/#/c/406574/ and https://gerrit.wikimedia.org/r/#/c/406622/ (duration: 01m 13s) [production]
19:45 <niharika29@tin> Synchronized docroot/noc/conf/uploadsdisabled.dblist: https://gerrit.wikimedia.org/r/#/c/405421 (duration: 00m 55s) [production]
19:43 <niharika29@tin> Synchronized dblists/uploadsdisabled.dblist: https://gerrit.wikimedia.org/r/#/c/405421/ (duration: 00m 56s) [production]
19:40 <niharika29@tin> Synchronized wmf-config/CommonSettings.php: Remove upload rights on wikis where local uploads are disabled T143789 (duration: 00m 56s) [production]
19:39 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: Remove upload rights on wikis where local uploads are disabled T143789 (duration: 00m 56s) [production]
19:37 <niharika29@tin> scap failed: average error rate on 9/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) [production]
19:22 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: Adding config for WikimediaEvents module for logging behavior data T183869 and beaureaucrats to add and remove accountcreator by default T185417 (duration: 00m 56s) [production]
19:19 <niharika29@tin> Synchronized wmf-config/InitialiseSettings-labs.php: Adding config for WikimediaEvents module for logging behaviour data T183869 (duration: 00m 57s) [production]