6051-6100 of 10000 results (50ms)
2016-12-05 §
11:26 <reedy@tin> Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 46s) [production]
10:58 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1082 - T148967 (duration: 00m 57s) [production]
10:38 <joal@tin> Finished deploy [analytics/refinery@2c3b78c]: (no message) (duration: 02m 19s) [production]
10:36 <joal@tin> Starting deploy [analytics/refinery@2c3b78c]: (no message) [production]
10:27 <gehel> enabling trace logging on indices recovery on elasticsearch codfw - T145065 [production]
08:01 <marostegui> Stop MySQL labsdb1010 - maintenance T152194 [production]
07:48 <marostegui> Deploy alter table db1082 - dewiki.revision - T148967 [production]
07:45 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1082 - T148967 (duration: 02m 12s) [production]
02:14 <godog> add --skip-ssl to mysql commands on eventlogging_sync on dbstore1002 - T152364 [production]
02:12 <godog> add --skip-ssl to mysql commands on eventlogging_sync on db1047 - T152364 [production]
01:57 <godog> move /var/log/eventlogging_sync.err to a symlink on /srv on db1047 [production]
2016-12-04 §
20:09 <eileen1> update civicrm from f8f9263d4aa0b5ba9b09827174c9b2e9a90a004c to 0f1e80b0c4cb97a7972cfd9f880fd36ab0b5d8c3 [production]
02:42 <godog> powercycle labservices1001 [production]
02:30 <godog> silence checker.tools.wmflabs.org for 2h [production]
2016-12-03 §
18:44 <krenair@tin> Synchronized wmf-config/mobile-labs.php: no-op in prod, this file is not loaded, for https://gerrit.wikimedia.org/r/#/c/325116/ (duration: 00m 45s) [production]
18:43 <krenair@tin> Synchronized wmf-config/CommonSettings-labs.php: no-op in prod, this file is not loaded, for https://gerrit.wikimedia.org/r/#/c/325119/ (duration: 00m 45s) [production]
03:08 <catrope@tin> Synchronized php-1.29.0-wmf.4/extensions/PageImages: SWAT: return any image, not just the non-free image (duration: 01m 31s) [production]
02:20 <mutante> iridium - starting fresh rsync of /srv/repos over to phab2001 as backup [production]
02:19 <mutante> phab2001 - deleted outdated contents of /srv/repos [production]
2016-12-02 §
23:33 <godog> roll-restart pdfrender on sbc after applying fonts.conf firejail whitelist [production]
22:41 <mutante> restarting salt-minion on all analytics servers [production]
22:24 <mutante> restarting salt-minion on all appservers (via debdeploy -s all-mw) [production]
22:19 <mutante> restarting salt-minion on mw-canary [production]
21:05 <mutante> scb2004 - depooling, restarting services, repooling [production]
20:42 <godog> roll-restart pdfrender on scb1* [production]
20:41 <mutante> scb2003 - depooling, restarting services, repooling [production]
20:39 <godog> upgrade thumbor to 0.1.31 on thumbor100[12] [production]
20:31 <mutante> scb2002 - depooling, restarting services, repooling [production]
20:18 <mutante> scb2001 - depooling, restarting services, repooling [production]
20:03 <mutante> scb1004 - depooling, restarting services, repooling [production]
19:35 <mutante> scb1003 - depooling, restarting services, repooling [production]
19:31 <dzahn@puppetmaster1001> conftool action : set/pooled=yes; selector: name=scb1002.eqiad.wmnet,service=apertium [production]
19:30 <dzahn@puppetmaster1001> conftool action : set/pooled=no; selector: name=scb1002.eqiad.wmnet,service=apertium [production]
19:22 <mutante> scb1002 - depooling, restarting services, repooling [production]
19:09 <mutante> scb1001 - re-pooling all services [production]
19:06 <mutante> scb1001 - restarting all (-oid) services [production]
19:04 <mutante> depooling all services on scb1001 for service restart [production]
19:03 <godog> rollback python-thumbor-wikimedia to 0.1.29 [production]
18:48 <godog> deploy thumbor 0.1.30 to thumbor100[12] [production]
17:18 <mobrovac> restbase deploy end of 1651e35 [production]
16:49 <mobrovac> restbase deploy start of 1651e35 [production]
15:39 <mobrovac@tin> Finished deploy [changeprop/deploy@8f53dc6]: (no message) (duration: 00m 54s) [production]
15:38 <mobrovac@tin> Starting deploy [changeprop/deploy@8f53dc6]: (no message) [production]
15:02 <_joe_> rolling restart of API appservers to catch up with the new jemalloc arenas config T151702 [production]
14:44 <oblivian@tin> Synchronized php-1.29.0-wmf.4/api.php: Reverting the API block after template has been protected (duration: 00m 45s) [production]
14:33 <marostegui> Deploy alter table wikidatawiki.revision in db2066 - T150644 [production]
13:45 <marostegui> Deploy alter table wikidatawiki.revision in db2059 -T150644 [production]
13:23 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1060 (duration: 00m 45s) [production]
11:56 <jynus> mysql restart for db1060 T152188 [production]
11:51 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Really depool db1060 && pool db1074 with full load after warmup (duration: 00m 44s) [production]