1-50 of 10000 results (56ms)
2018-05-18 §
21:45 <tgr> updated some OAuth consumer for a hackathon project: update oauth_registered_consumer set oarc_callback_url = 'http://localhost' where oarc_consumer_key = '2828bd9ca9bdcd81a960721819f25e90'; [production]
21:17 <demon@tin> Finished deploy [gerrit/gerrit@a07d943]: quota plugin (duration: 00m 11s) [production]
21:16 <demon@tin> Started deploy [gerrit/gerrit@a07d943]: quota plugin [production]
19:36 <Reedy> tstarling manually loaded Tor Exit Nodes on wikitech [production]
19:01 <chasemp> unlock bawolff gerrit account [production]
18:11 <mutante> neon, netmon1002 - start ferm service [production]
18:09 <mutante> einsteinium: started ferm service [production]
18:03 <jynus> stop replication and start schema change on db1105 [production]
17:48 <faidon@tin> Finished deploy [netbox/deploy@90164b3]: Update netbox to 2.2.4 + WMF patches (duration: 00m 05s) [production]
17:48 <faidon@tin> Started deploy [netbox/deploy@90164b3]: Update netbox to 2.2.4 + WMF patches [production]
17:47 <faidon@tin> Finished deploy [netbox/deploy@90164b3]: Update netbox to 2.2.4 + WMF patches (duration: 00m 05s) [production]
17:47 <faidon@tin> Started deploy [netbox/deploy@90164b3]: Update netbox to 2.2.4 + WMF patches [production]
17:45 <faidon@tin> Finished deploy [netbox/deploy@90164b3]: Update netbox to 2.2.4 + WMF patches (duration: 00m 32s) [production]
17:45 <faidon@tin> Started deploy [netbox/deploy@90164b3]: Update netbox to 2.2.4 + WMF patches [production]
16:00 <gehel> reduce replication of maps v4 keyspace to 3 [production]
15:59 <reedy@tin> Synchronized php-1.32.0-wmf.4/extensions/VisualEditor/: Fix dialog (duration: 01m 19s) [production]
15:45 <reedy@tin> Synchronized wmf-config/throttle.php: throttling! (duration: 01m 22s) [production]
15:44 <marostegui> Stop MySQL and reboot db1067 - T194852 [production]
15:38 <reedy@tin> Synchronized php-1.32.0-wmf.3/extensions/VisualEditor/: Fix dialog (duration: 01m 25s) [production]
15:31 <gehel> rolling restart of cassandra on maps1* (repair was started on each node, instead of sequentially) [production]
15:23 <gehel> clear cassandra snapshots on maps1002 [production]
13:59 <marostegui> Manually fail disk #6 on db1066 - T194870 [production]
13:19 <bawolff_> reset 2FA for Trizek_(WMF) [production]
12:26 <jynus> stop and reimage db2041 [production]
10:15 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1085 with low load (duration: 01m 20s) [production]
09:47 <marostegui> Stop MySQL on db1116 for testing [production]
09:44 <marostegui> Stop MySQL on db2092 for testing [production]
09:43 <hoo> Updated the Wikidata property suggester with data from Monday's JSON dump and applied the T132839 workarounds [production]
09:33 <gehel> cleared v3 snapshot on maps servers [production]
09:25 <jynus> stop and reimage db1085 [production]
09:24 <gehel> drop v3 keyspace on cassandra maps (unused since migration to i18n) [production]
09:01 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1085 (duration: 01m 20s) [production]
08:32 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1105:s6 and other vslow hosts (duration: 01m 21s) [production]
06:14 <XioNoX> bumping eqsin-codfw link OSPF metric to 5000 (due to packet loss on link) [production]
05:37 <marostegui> Stop MySQL on db1120 to copy its content to db2075 - T190704 [production]
05:33 <marostegui> Deploy schema change on dbstore1002:s3 - T191519 T188299 T190148 [production]
05:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1066 - T193847 (duration: 01m 22s) [production]
05:24 <marostegui> Reload haproxy on dbproxy1010 to repool labsdb1011 [production]
05:18 <marostegui> Stop MySQL and reboot db1067 - T194852 [production]
01:34 <twentyafterfour@tin> Synchronized php-1.32.0-wmf.4: sync wmf.4 to deploy https://gerrit.wikimedia.org/r/#/c/433673/ (duration: 09m 54s) [production]
01:27 <twentyafterfour> syncing wmf.4 again to deploy https://gerrit.wikimedia.org/r/#/c/433673/ refs T194900 T191050 [production]
00:19 <mutante> rdb2004 - down in Icinga since >1d, nothing on console, dont see a SAL entry. powercycling [production]
2018-05-17 §
23:35 <twentyafterfour> MediaWiki Train for 1.32.0-wmf.4 remains blocked by critical bugs, see T191050 for a list of blockers. [production]
23:34 <twentyafterfour@tin> Synchronized php: group1 wikis to 1.32.0-wmf.3 refs T191050 (duration: 01m 20s) [production]
23:32 <twentyafterfour@tin> rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.3 refs T191050 [production]
23:29 <twentyafterfour> rolling back [production]
23:29 <twentyafterfour> still seeing Notice: Undefined variable: nonce in /srv/mediawiki/php-1.32.0-wmf.4/includes/resourceloader/ResourceLoaderClientHtml.php on line 272 [production]
23:28 <twentyafterfour@tin> Synchronized php: group1 wikis to 1.32.0-wmf.4 refs T191050 (duration: 01m 17s) [production]
23:26 <twentyafterfour@tin> rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.4 refs T191050 [production]
23:22 <twentyafterfour@tin> Synchronized php-1.32.0-wmf.4/: sync https://gerrit.wikimedia.org/r/#/c/433673/ refs T194900 (duration: 09m 54s) [production]