751-800 of 10000 results (52ms)
2017-10-18 ยง
18:42 <andrewbogott> restarting rabbitmq-server on labcontrol1001; too many timeouts [production]
16:29 <elukey> stop ircecho on einstenium for puppet shower [production]
16:27 <herron> restarted apache on puppetmasters [production]
14:23 <moritzm> uploaded hhvm 3.18.5+dfsg-1+wmf1+deb9u1 to apt.wikimedia.org/stretch-wikimedia [production]
14:03 <chasemp> add static ip to cloud mwstake project per T178012 [production]
14:03 <chasemp> bump up quota on cyberpower cloud project per T178332 [production]
14:03 <chasemp> create reading-lists cloud project [production]
13:28 <zeljkof> EU SWAT finished! [production]
13:22 <zfilipin@tin> Synchronized php-1.31.0-wmf.3/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:384669|[cirrus] Turn on recall A/B test on enwiki (T177502)]] (duration: 00m 50s) [production]
13:21 <gehel> repooling wdqs1003 now that it has catched up on updates [production]
13:15 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:383378|pagePreviews: Restart A/B test on enwiki and dewiki (T176469)]] (duration: 00m 51s) [production]
13:05 <moritzm> uploaded wikidiff2 1.5.1 to apt.wikimedia.org [production]
12:11 <mobrovac@tin> Finished deploy [restbase/deploy@3c7abf6]: Bug fix: Remove the space in the summary table name (duration: 07m 13s) [production]
12:04 <mobrovac@tin> Started deploy [restbase/deploy@3c7abf6]: Bug fix: Remove the space in the summary table name [production]
11:54 <mobrovac@tin> Finished deploy [restbase/deploy@99052c1]: Use Cass3 storage for ruwiki summaries (duration: 08m 59s) [production]
11:47 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Add db1105 to help db1071 because db1082 has crashed (duration: 00m 50s) [production]
11:45 <mobrovac@tin> Started deploy [restbase/deploy@99052c1]: Use Cass3 storage for ruwiki summaries [production]
11:31 <moritzm> upgrading mw1262-mw1265 (canaries) to wikidiff2 1.5.1 [production]
11:26 <marostegui> Optimize pagelinks and templatelinks on db1102 s7 - T174509 [production]
11:21 <moritzm> upgrading mw1261 to wikidiff2 1.5.1 [production]
11:11 <mobrovac@tin> Finished deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now), part #2 (duration: 08m 53s) [production]
11:03 <mobrovac@tin> Started deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now), part #2 [production]
11:02 <mobrovac@tin> Finished deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now) (duration: 05m 23s) [production]
10:57 <mobrovac@tin> Started deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now) [production]
10:50 <moritzm> rebooting multatuli for kernel update [production]
10:21 <moritzm> imported linux 4.9.30-2+deb9u5~bpo8+1 for jessie-wikimedia [production]
09:51 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1098, depool db1082 (crashed) (duration: 00m 50s) [production]
09:39 <moritzm> installing xserver/xvfb security updates [production]
09:36 <jynus> reloading dbproxy1010's haproxy configuration [production]
09:30 <elukey> drop MobileWikiAppToCInteraction_10375484_15423246 from the log database on dbstore1002,db1047,db1046 - T177960 [production]
08:41 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Re-enable Statement usage tracking on cawiki (T151717) (duration: 00m 50s) [production]
08:25 <marostegui> Stop MySQL on db2019 to copy its data to db2084 - T178359 [production]
08:23 <mobrovac@tin> Finished deploy [changeprop/deploy@065a06e]: Bug fix: Apply ignore_errors on a per-request basis (duration: 01m 17s) [production]
08:22 <mobrovac@tin> Started deploy [changeprop/deploy@065a06e]: Bug fix: Apply ignore_errors on a per-request basis [production]
08:09 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Enable description usage tracking on a few test wikis (T177155) (duration: 00m 50s) [production]
07:49 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1056 - T174509 (duration: 00m 49s) [production]
07:46 <marostegui> Optimize pagelinks and templatelinks on db1056 - T174509 [production]
07:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1034 - T174509 (duration: 00m 59s) [production]
07:14 <gehel> depooling wdqs1003 until it catches up on updates [production]
07:02 <marostegui> Stop MySQL on db2079 to copy its data to db2084 - T178359 [production]
06:46 <_joe_> powercycling wdqs1003 [production]
05:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1072 - T164488 (duration: 00m 49s) [production]
05:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1055 - T174509 (duration: 00m 50s) [production]
05:40 <marostegui> Optimize pagelinks and templatelinks on db1055 - T174509 [production]
05:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1098 - T174509 (duration: 00m 49s) [production]
05:36 <marostegui> Optimize pagelinks and templatelinks on db1098 - T174509 [production]
05:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T174509 (duration: 00m 50s) [production]
05:25 <marostegui> Optimize pagelinks and templatelinks on db1102 for s2 - T174509 [production]
03:17 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Oct 18 03:17:01 UTC 2017 (duration 7m 3s) [production]
03:09 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.4) (duration: 14m 58s) [production]