|
2015-12-11
§
|
| 19:13 |
<mutante> |
creating cygnus.codfw.wmnet on ganeti2001 |
[production] |
| 19:06 |
<demon@tin> |
Synchronized wmf-config/wikitech.php: rm some old ldap stuff. yay hiera! (duration: 00m 28s) |
[production] |
| 18:54 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: rm some deprecated profiling config (duration: 00m 28s) |
[production] |
| 18:29 |
<demon@tin> |
Synchronized docroot/: cleanup wgconf vhost config (the sequel) (duration: 00m 29s) |
[production] |
| 18:28 |
<demon@tin> |
Synchronized wmf-config/: cleanup wgconf vhost config (duration: 00m 29s) |
[production] |
| 18:13 |
<demon@tin> |
Synchronized wmf-config/: Remove ability to turn off Cirrus completely. It's a scary switch that would Break Everything. There's much better options to use if you need to tune its load or behavior. (duration: 00m 29s) |
[production] |
| 17:54 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1057 for maintenance (duration: 00m 35s) |
[production] |
| 17:44 |
<jynus> |
rolling restart of codfw's S1 mysqls finished |
[production] |
| 16:36 |
<mark> |
Installed bgp-med branch of operations/debs/pybal on pybal-test2001 |
[production] |
| 16:23 |
<mark> |
moved quagga install from pybal-test2001 to pybal-test2002 |
[production] |
| 14:54 |
<jynus> |
restarting and configuring S1:codfw mysqls (db2016,34,42,48,55,62,69,70) |
[production] |
| 14:40 |
<mark> |
root@pybal-test2001:~# apt-get install quagga |
[production] |
| 14:21 |
<andrewbogott> |
re-imaging promethium |
[production] |
| 10:57 |
<_joe_> |
rolling restart of HHVM across the jobrunners to ease memory consumption (this will go on during the day, hhvm restarts will be distantiated by 2 hours each) |
[production] |
| 10:53 |
<_joe_> |
restarting hhvm on mw1122 in order to collect heap dumps |
[production] |
| 10:35 |
<jynus> |
restarting HHVM on mw1122, mw1145 |
[production] |
| 09:50 |
<jynus> |
importing several tables from master to dbstore1002 and labs, lag will will be slightly affected |
[production] |
| 09:26 |
<_joe_> |
ganeti-rebooting serpens, cannot get into console |
[production] |
| 07:10 |
<dcausse> |
deleting some indexing slow logs on elastic1012 and elastic1016 |
[production] |
| 06:46 |
<gwicke> |
deploy restbase c67a41e9d52: add an expensive title to re-render blacklist, per subbu's request |
[production] |
| 03:21 |
<gwicke> |
upgraded codfw nodes to 2.1.12 |
[production] |
| 02:46 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Dec 11 02:46:13 UTC 2015 (duration 6m 46s) |
[production] |
| 02:39 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.8) (duration: 17m 01s) |
[production] |
| 02:34 |
<gwicke> |
restarted nodetool decommission on restbase1007, as I had to restart one of the stream targets |
[production] |
| 02:15 |
<bblack> |
unified cert upgrades complete |
[production] |
| 01:42 |
<bblack> |
starting unified cert upgrade process |
[production] |
| 01:13 |
<ori@tin> |
Synchronized php-1.27.0-wmf.8/includes/jobqueue: Ia44ec5ed4: Add per-partition JobQueueRedis aggregation + Fix bad regex in 6fe2f48df (duration: 00m 31s) |
[production] |
| 00:59 |
<andrewbogott> |
rebooting promethium |
[production] |
| 00:58 |
<bd808@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add read-more to beta features whitelist (duration: 00m 30s) |
[production] |
| 00:27 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Search language detection A/B test and RelatedArticles on all Wikipedias in beta (duration: 00m 29s) |
[production] |
| 00:20 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/CirrusSearch: SWAT (duration: 00m 30s) |
[production] |
| 00:20 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/RelatedArticles: SWAT (duration: 00m 29s) |
[production] |
| 00:19 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/ImageMap: SWAT (duration: 00m 29s) |
[production] |
| 00:19 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Graph: SWAT (duration: 00m 30s) |
[production] |
| 00:08 |
<catrope@tin> |
Synchronized wmf-config/CommonSettings.php: Staff password policy, take 2 (duration: 00m 28s) |
[production] |
| 00:06 |
<catrope@tin> |
Synchronized portals/: SWAT (duration: 00m 30s) |
[production] |
|
2015-12-10
§
|
| 23:55 |
<gwicke> |
restbase: deploy 9657c4e |
[production] |
| 23:38 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Math: Fix errors (duration: 00m 29s) |
[production] |
| 23:38 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Echo: Fix errors (duration: 00m 29s) |
[production] |
| 23:27 |
<ori@tin> |
Synchronized php-1.27.0-wmf.8/extensions/WikimediaEvents: Ia44ec5ed4: Updated mediawiki/core Project: mediawiki/extensions/WikimediaEvents 152ecb10311bb04f4f2f91775cf821aff14aa327 (duration: 00m 30s) |
[production] |
| 23:20 |
<krenair@tin> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 29s) |
[production] |
| 22:48 |
<csteipp> |
Re-deployed a bunch of security patches for wmf8 |
[production] |
| 22:05 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/VisualEditor/: SWAT (duration: 00m 47s) |
[production] |
| 21:56 |
<gwicke> |
restbase: finished full deploy of 7398850fe9 to restbase cluster |
[production] |
| 21:49 |
<gwicke> |
restbase: starting full deploy of 7398850fe9 to restbase cluster |
[production] |
| 21:49 |
<catrope@tin> |
Synchronized wmf-config/: SWAT: VisualEditor config patches (duration: 00m 30s) |
[production] |
| 21:46 |
<gwicke> |
restbase: canary deploy of 7398850fe9 to restbase1001 |
[production] |
| 21:44 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Gadgets/: Fix MediaWiki:MediaWiki: (duration: 00m 29s) |
[production] |
| 21:35 |
<catrope@tin> |
Synchronized wmf-config/CommonSettings.php: New password policy for staff group (duration: 00m 28s) |
[production] |
| 21:28 |
<catrope@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: Echo and Flow config patches (duration: 00m 29s) |
[production] |