2017-02-08
§
|
09:44 |
<elukey> |
boostrapping aqs1009-b (last new AQS Cassandra instance) |
[production] |
09:31 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic2004.codfw.wmnet |
[production] |
09:31 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic2003.codfw.wmnet |
[production] |
08:56 |
<ema> |
cache_upload: upgrade to jessie 8.7 and reboot into kernel 4.4.2-3+wmf8 T155401 |
[production] |
08:42 |
<gehel> |
drain shards from elastic200[5678] in preparation for reimage - T151326 |
[production] |
08:18 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic2004.codfw.wmnet |
[production] |
08:18 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic2003.codfw.wmnet |
[production] |
08:16 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic2002.codfw.wmnet |
[production] |
07:59 |
<marostegui> |
Adding 100G to the lv on dbstore1001 |
[production] |
07:23 |
<marostegui> |
Restart MySQL db1095 and labsdb1009 for maintenance - T153743 |
[production] |
03:08 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Feb 8 03:08:05 UTC 2017 (duration 5m 43s) |
[production] |
03:02 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.11) (duration: 15m 32s) |
[production] |
02:29 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.10) (duration: 07m 35s) |
[production] |
01:02 |
<mutante> |
mw1294 - run puppet because it popped up in Icinga as failed - removes a bunch of /var/tmp/core/../rsvg-convert.*, all else normal |
[production] |
00:56 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT [[gerrit:335732|Setting $wgPageAssessmentsSubprojects to true on beta cluster]] (housekeeping sync) (duration: 00m 40s) |
[production] |
00:55 |
<mutante> |
mw1189 service hhvm restart |
[production] |
00:55 |
<mutante> |
iridum - apache graceful'ed |
[production] |
00:51 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:336466|Update footer logos on mobile site for various projects]] PART II T157476 (duration: 00m 41s) |
[production] |
00:50 |
<thcipriani@tin> |
Synchronized static/images/mobile/copyright: SWAT: [[gerrit:336466|Update footer logos on mobile site for various projects]] PART I T157476 (duration: 00m 41s) |
[production] |
00:16 |
<thcipriani@tin> |
Synchronized wmf-config: SWAT: [[gerrit:334729|Deploy TextCat Improvements]] T149324 T142140 (duration: 00m 45s) |
[production] |
2017-02-07
§
|
23:42 |
<mutante> |
carbon - stopping DHCP service (install* should be used) |
[production] |
22:31 |
<otto@tin> |
Finished deploy [eventstreams/deploy@e86077c]: (no justification provided) (duration: 02m 26s) |
[production] |
22:28 |
<otto@tin> |
Started deploy [eventstreams/deploy@e86077c]: (no justification provided) |
[production] |
21:17 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.29.0-wmf.11 |
[production] |
21:02 |
<eileen1> |
Update CiviCRM from e45da6dc2cfaa48da8807ab9a571810c119e3233 to 7b36996e87387bb4982cc6937dc8bcbc7952eaf2 |
[production] |
21:01 |
<thcipriani@tin> |
Finished scap: testwiki to php-1.29.0-wmf.11 and rebuild l10n cache (duration: 51m 53s) |
[production] |
20:10 |
<thcipriani@tin> |
Started scap: testwiki to php-1.29.0-wmf.11 and rebuild l10n cache |
[production] |
19:43 |
<gehel> |
deploying analysis-stempel plugin on relforge and cluster restart |
[production] |
19:34 |
<gehel> |
drain shards from elastic200[34] in preparation for reimage - T151326 |
[production] |
19:30 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1015 after maintenance (duration: 01m 34s) |
[production] |
18:58 |
<jynus> |
preparing db2043 for reimage T152188 |
[production] |
18:55 |
<jynus> |
restarting and upgrading db1015 T152188 |
[production] |
18:55 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1015 after maintenance (duration: 00m 54s) |
[production] |
18:33 |
<thcipriani> |
starting branch cut for MediaWiki and extensions 1.29.0-wmf.11 |
[production] |
18:24 |
<arlolra> |
Updated Parsoid to f0732260 (T109897) |
[production] |
18:20 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1022 after maintenance (duration: 00m 40s) |
[production] |
18:18 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@c3a5c55]: Updating Parsoid to f0732260 (duration: 09m 05s) |
[production] |
18:09 |
<arlolra@tin> |
Started deploy [parsoid/deploy@c3a5c55]: Updating Parsoid to f0732260 |
[production] |
17:50 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic2001.codfw.wmnet |
[production] |
17:07 |
<jynus> |
restarting and upgrading db1022 T152188 |
[production] |
17:05 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1022 for maintenance (duration: 00m 40s) |
[production] |
16:22 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1021 (duration: 00m 57s) |
[production] |
16:08 |
<jynus> |
restarting and upgrading db2064 T152188 |
[production] |
14:56 |
<jynus> |
preparing db2036 for reimage T152188 |
[production] |
14:42 |
<gehel> |
drain shards from elastic2001 / elastic2002 in preperation for reimage - T151326 |
[production] |
14:28 |
<hashar> |
European swat copleted |
[production] |
14:27 |
<elukey> |
restarting hhvm on mw1304 (load very high, no queue, threads locked - /tmp/hhvm.62070.bt.) |
[production] |
14:22 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: Namespace changes for elwikisource - T157187 (duration: 00m 40s) |
[production] |
14:19 |
<elukey> |
restarting all the Yarn Node Managers on the Hadoop worker nodes to pick up the new config - T156932 |
[production] |
14:12 |
<hoo@tin> |
Synchronized wmf-config/: Search index article placeholders on cywiki up to Q2794 (T144592) (duration: 00m 42s) |
[production] |