1-50 of 10000 results (33ms)
2017-08-13 §
22:45 <ebernhardson> restart elsaticsearch on elastic1017 after setting md2 readahead to 256 to match md2 on 1032-152 [production]
19:35 <godog> upload python-thumbor-wikimedia 1.2 - T161719 [production]
19:01 <godog> bounce pdfrender on scb1001 and scb1003 - T159922 [production]
18:46 <godog> bounce carbon and uwsgi on graphite1003 [production]
17:53 <reedy@tin> Synchronized wmf-config/db-eqiad.php: fix comment (duration: 00m 47s) [production]
17:52 <reedy@tin> Synchronized wmf-config/db-codfw.php: fix comment (duration: 00m 47s) [production]
17:51 <reedy@tin> Synchronized refresh-dblist: phpcs (duration: 00m 48s) [production]
2017-08-12 §
20:00 <krinkle@tin> Synchronized php-1.30.0-wmf.13/includes/jobqueue/JobQueueGroup.php: T171371 - Log job pushes to bogus wikis (duration: 00m 53s) [production]
16:09 <Reedy> Deleted some bogus user languages from commonswiki.user_properties [production]
15:25 <elukey> powercycle mw2256 (able to use com2 but not to login as root, regular ssh hanging) - T163346 [production]
2017-08-11 §
21:47 <legoktm@tin> Finished scap: (no justification provided) (duration: 07m 09s) [production]
21:41 <jmm@puppetmaster1001> conftool action : set/pooled=inactive; selector: mw2256.codfw.wmnet [production]
21:40 <legoktm@tin> Started scap: (no justification provided) [production]
21:40 <legoktm@tin> scap failed: LockFailedError Failed to acquire lock "/var/lock/scap.unknown-but-probably-mediawiki.lock"; owner is "legoktm"; reason is "Deploying Timeless (try 2) - T154371" (duration: 00m 00s) [production]
21:02 <ebernhardson> unban elastic1017 from elasticsearch cluster [production]
20:52 <bblack> varnish backend restart on cp1099 [production]
20:46 <legoktm@tin> Started scap: Deploying Timeless (try 2) - T154371 [production]
20:42 <legoktm@tin> scap aborted: Deploying Timeless - T154371 (duration: 05m 10s) [production]
20:36 <legoktm@tin> Started scap: Deploying Timeless - T154371 [production]
20:19 <bblack> varnish backend restart on cp1049 + cp1074 (mailbox lag) [production]
19:59 <ebernhardson> ban elastic1017 from eqiad search cluster [production]
18:28 <moritzm> installing subversion security updates [production]
17:19 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2075 (duration: 00m 47s) [production]
17:05 <twentyafterfour> Deploying phabricator security update [production]
16:21 <jynus_> stop db1069:s6 replication and dropping frwiki, jawiki, ruwiki [production]
15:41 <jynus_> stopping db2075 to clone it to dbstore2001 [production]
15:39 <moritzm> installing git security updates on trusty (jessie/stretch already fixed) [production]
15:38 <jynus@tin> Synchronized wmf-config/db-codfw.php: Depool db2075 (duration: 00m 48s) [production]
13:51 <elukey> moved the eventbus scap deployment dirs on kafka[12]00[123] to deploy-service:deploy-service to allow scap to depool/pool - T171506 [production]
13:49 <mobrovac@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 27s) [production]
13:49 <mobrovac@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
13:42 <mobrovac@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 13s) [production]
13:42 <mobrovac@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
13:25 <mobrovac@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 34s) [production]
13:24 <mobrovac@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
13:16 <mobrovac@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 12s) [production]
13:15 <mobrovac@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
13:00 <mobrovac@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 17s) [production]
13:00 <mobrovac@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
12:51 <mobrovac@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 04s) [production]
12:51 <mobrovac@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
12:44 <mobrovac@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 05s) [production]
12:44 <mobrovac@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
12:05 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2046 - T151029 (duration: 00m 48s) [production]
11:25 <jynus> stopping and upgrading labsdb1010 [production]
11:19 <marostegui> Stop replication on db2046 to fix duplicate entries - T151029 [production]
09:28 <jynus> stopping and restarting es2013 for upgrade [production]
09:07 <jynus> stopping and restarting db2046 for upgrade [production]
07:35 <elukey> restart pdfrender on scb1004 [production]
2017-08-10 §
23:43 <maxsem@tin> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/371196/2 (duration: 00m 47s) [production]