2301-2350 of 10000 results (40ms)
2017-03-16 §
20:08 <dzahn@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=elastic2020.codfw.wmnet [production]
20:08 <dzahn@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2010.codfw.wmnet [production]
20:06 <mutante> depooled elastic2010 since it is powered-off/down. (set/pooled=inactive) - (T149006) [production]
20:05 <dzahn@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=elastic2010.codfw.wmnet [production]
20:05 <twentyafterfour> restarted phd on iridium to fix workers dieing [production]
19:26 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.16 [production]
19:07 <thcipriani@tin> Synchronized php-1.29.0-wmf.16/extensions/VisualEditor/lib/ve: SWAT: [[gerrit:343072|Update VE core submodule to wmf/1.29.0-wmf.16 HEAD]] (50a6323d7) T154123 T160479 (duration: 00m 44s) [production]
19:01 <gehel> restart relforge to activate new plugins - T160674 [production]
16:57 <ebernhardson> started cirrus completion indices rebuild for group2 on wasat.codfw.wmnet [production]
16:48 <ebernhardson> manually adjusted wikiversions on wasat.codfw.wmnet to point all wikis at wmf.16 to rebuild cirrus completion search indices before group2 rolls forward [production]
16:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase weight for db1070 - T157931 (duration: 00m 41s) [production]
16:32 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2065 - T160415 - T73563 (duration: 00m 42s) [production]
16:01 <marostegui> Deploy schema change on s4 (commonswiki) https://phabricator.wikimedia.org/T73563 and https://phabricator.wikimedia.org/T160415 [production]
16:00 <elukey> racadm serveraction powerdown on mw2256 for hw maintenance [production]
15:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1092 - T160415 (duration: 00m 42s) [production]
15:44 <godog> reboot ms-be1008 after disk swap to clear stuck mkfs.xfs [production]
15:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1092 - T160415 (duration: 00m 42s) [production]
15:27 <otto@tin> Finished deploy [eventlogging/eventbus@75ab39c]: /v1/schemas/:schema_uri endpoint, T159179 (duration: 00m 14s) [production]
15:27 <otto@tin> Started deploy [eventlogging/eventbus@75ab39c]: /v1/schemas/:schema_uri endpoint, T159179 [production]
15:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1087 - T160415 (duration: 00m 42s) [production]
15:13 <elukey> restart hhvm on mw1200, high load and queued requests - hhvm-dump-debug on /tmp/hhvm.27107.bt. [production]
15:09 <elukey> restart hhvm on mw1207, high load and queued requests - hhvm-dump-debug on /tmp/hhvm.27441.bt. [production]
15:00 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1087 - T160415 (duration: 00m 42s) [production]
14:50 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1082 - T160415 (duration: 00m 41s) [production]
14:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1082 - T160415 (duration: 00m 42s) [production]
14:31 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1070 with low weight - T157931 (duration: 00m 45s) [production]
14:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1045 - T160415 (duration: 00m 43s) [production]
14:12 <Dereckson> EU SWAT, round 2, done [production]
14:11 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Create Wikichanzo namespace for swwiki T158041) (duration: 00m 42s) [production]
14:07 <dereckson@tin> Synchronized wmf-config/throttle.php: Add Odia Wikipedia's 100 Women Editathon throttle rule (T160619) (duration: 00m 57s) [production]
13:52 <Dereckson> Resume EU SWAT for two new changes [production]
13:52 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1045 - T160415 (duration: 00m 58s) [production]
13:38 <marostegui> Shutdown es2015 for maintenance - T160242 [production]
13:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1026 - T160415 (duration: 00m 42s) [production]
13:15 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1026 - T160415, Repool db1067 - T160435 (duration: 00m 42s) [production]
13:01 <addshore> EU SWAT done [production]
12:59 <addshore@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:342644|Add new throttle rule]] T160427 (lift of IP cap for RIT - March 25, 2017) (duration: 00m 43s) [production]
12:49 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:343033|wmgUseInterwikiSorting true for wikidataclients]] T160465 T150183 (duration: 00m 42s) [production]
12:39 <marostegui> Deploy schema change on s5 - T160415 [production]
12:38 <addshore@tin> Synchronized php-1.29.0-wmf.16/extensions/InterwikiSorting: [[gerrit:343032|Use ExtensionFunctions instead of BeforeInitialize hook]] T160465 (duration: 00m 44s) [production]
12:31 <addshore@tin> Synchronized php-1.29.0-wmf.16/extensions/InterwikiSorting: [[gerrit:343032|Use ExtensionFunctions instead of BeforeInitialize hook]] T160465 (duration: 00m 43s) [production]
12:17 <addshore@tin> Synchronized php-1.29.0-wmf.15/extensions/InterwikiSorting: [[gerrit:343031|Use ExtensionFunctions instead of BeforeInitialize hook]] T160465 (duration: 00m 43s) [production]
11:48 <godog> repair prometheus' leveldb database archived_fingerprint_to_metric on bast3002, upgrade prometheus to latest version from jessie-backports [production]
11:26 <moritzm> enabled BBR as TCP congestion control algorithm on cp1008 [production]
11:04 <joal@tin> Finished deploy [analytics/aqs/deploy@006bf8c]: (no justification provided) (duration: 03m 30s) [production]
11:01 <joal@tin> Started deploy [analytics/aqs/deploy@006bf8c]: (no justification provided) [production]
10:59 <joal@tin> Finished deploy [analytics/aqs/deploy@006bf8c]: (no justification provided) (duration: 02m 13s) [production]
10:56 <joal@tin> Started deploy [analytics/aqs/deploy@006bf8c]: (no justification provided) [production]
10:12 <volans> upgraded cumin to version 0.0.2 in the repository and on neodymium/sarin [production]
10:07 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1051 - T160415 (duration: 00m 41s) [production]