201-250 of 10000 results (30ms)
2016-07-22 §
02:35 <jynus> SET GLOBAL read_only=0; on db1048 [production]
02:34 <jynus> updating m3-master dns [production]
02:33 <jynus> setting db1043 as read-only (phabricator/m3) [production]
02:31 <jynus> making dbstore1002.eqiad.wmnet:3306 a child of db1048.eqiad.wmnet:3306 [production]
02:27 <jynus> making db2012.codfw.wmnet:3306 a child of db1048.eqiad.wmnet [production]
02:25 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Jul 22 02:25:53 UTC 2016 (duration 5m 47s) [production]
02:20 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.11) (duration: 08m 23s) [production]
00:53 <bd808> Restarted elasticsearch on logstash1003; couldn't find master (even though the master thought 1003 was fine) [production]
00:43 <mutante> restarted grrrit-wm [production]
00:01 <maxsem@tin> Synchronized wmf-config/InitialiseSettings-labs.php: Labs-only cleanups (duration: 00m 25s) [production]
2016-07-21 §
23:53 <Amir1> deploying 2d9817b to ores in scb nodes [production]
23:49 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 24s) [production]
23:46 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#q,298344,n,z (duration: 00m 24s) [production]
23:41 <MaxSem> on tin: ran mwscript extensions/ShortUrl/populateShortUrlTable.php --wiki=urwiki [production]
23:39 <MaxSem> created ShortUrl tables on urwiki [production]
23:37 <ori> Restarted statsv on hafnium (cc Krinkle). 'gaierror: [Errno -3] Temporary failure in name resolution' [production]
23:34 <maxsem@tin> Synchronized php-1.28.0-wmf.11/extensions/CirrusSearch/: https://gerrit.wikimedia.org/r/#q,300430,n,z https://gerrit.wikimedia.org/r/#q,300436,n,z (duration: 00m 32s) [production]
23:32 <maxsem@tin> Synchronized php-1.28.0-wmf.11/extensions/EventBus/: https://gerrit.wikimedia.org/r/#q,300332,n,z (duration: 00m 26s) [production]
23:27 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/299619/ (duration: 00m 24s) [production]
23:22 <maxsem@tin> Synchronized wmf-config/: https://gerrit.wikimedia.org/r/#/c/299615/ (duration: 00m 29s) [production]
23:21 <Amir1> restarting uwsgi and celery for ores in scb1002 [production]
23:20 <maxsem@tin> Synchronized dblists/wikidatadescriptions.dblist: https://gerrit.wikimedia.org/r/#/c/299615/ (duration: 00m 24s) [production]
23:19 <Amir1> restarting uwsgi and celery for ores in scb 1001 [production]
23:09 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/298933/ (duration: 00m 29s) [production]
22:46 <ebernhardson> restart elasticsearch on logstash1002 [production]
22:22 <bd808> Restarted kibana4 on logstash1001 for "node[18588]: segfault at 2fcb25f00009 ip 0000000000ad9846 sp 00007ffe526bbb40 error 4 in node[400000+1383000]" [production]
22:01 <mutante> stat1002 - puppetized git pull from "refinery_source" fails [production]
21:11 <reedy@tin> Synchronized wmf-config/CommonSettings.php: Moved WMF specific SiteMatrix data to CommonSettings (duration: 00m 26s) [production]
20:28 <ejegg> re-enabled fundraising campaigns after schema update [production]
19:27 <demon@tin> Synchronized wikiversions.json: because sync-wikiversions doesn't care about co-masters ugh (duration: 00m 29s) [production]
19:09 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: last wikis to wmf.11 [production]
19:07 <ejegg> disabled fundraising CentralNotice campaigns for paymentswiki schema update [production]
18:34 <ejegg> updated payments-wiki from f23f15656eb488f5008b45b940077abbaa779004 to 79d2b67067fd7e579372b63e0d619eccfa3b9143 [production]
17:33 <mutante> restarted grrrit-wm [production]
17:26 <krinkle@tin> Synchronized w/static.php: allow short-lived caching of 400/500 errors (duration: 00m 24s) [production]
17:15 <ostriches> gerrit: restarting [production]
17:13 <ostriches> gerrit: killed a couple of long-running git-upload-pack's for mediawiki/core [production]
17:07 <gehel> cleaning leftover crons on logstash* servers - T140973 [production]
16:51 <urandom> T134016: Starting bootstrap of restbase2003-c.codfw.wmnet [production]
16:51 <urandom> T134016: Restart of codfw rack 'c' instances to apply stream socket timeout complete [production]
16:47 <urandom> T134016: Restarting Cassandra to apply new stream timeout (restbase2008-b.codfw.wmnet) [production]
16:46 <ebernhardson@tin> Synchronized php-1.28.0-wmf.11/extensions/CirrusSearch/includes/Searcher.php: T140950: Deploy UBN fix to CirruSearch (duration: 00m 31s) [production]
16:46 <urandom> T134016: Restarting Cassandra to apply new stream timeout (restbase2008-a.codfw.wmnet) [production]
16:43 <urandom> T134016: Restarting Cassandra to apply new stream timeout (restbase2004-b.codfw.wmnet) [production]
16:41 <urandom> T134016: Restarting Cassandra to apply new stream timeout (restbase200r-a.codfw.wmnet) [production]
16:38 <urandom> T134016: Restarting Cassandra to apply new stream timeout (restbase2003-b.codfw.wmnet) [production]
16:36 <urandom> T134016: Restarting Cassandra to apply new stream timeout (restbase2003-a.codfw.wmnet) [production]
16:30 <subbu> finished (test) deploy of parsoid sha ed2f8228 [production]
16:28 <urandom> Cancelling 2003-c bootstrap, and disabling Puppet on restbase2003.codfw.wmnet to keep instance down : T134016 [production]
16:27 <subbu> synced parsoid code; restarting parsoid on wtp1001 as a canary [production]