|
2017-04-11
ยง
|
| 19:08 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.20 |
[production] |
| 19:01 |
<ppchelko@tin> |
Finished deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001, attempt#3 T160764 (duration: 00m 52s) |
[production] |
| 19:00 |
<ppchelko@tin> |
Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001, attempt#3 T160764 |
[production] |
| 18:34 |
<elukey> |
restart hhvm on mw1165 (debug in /tmp/hhvm.5384.bt.) |
[production] |
| 18:25 |
<demon@tin> |
Finished scap: testwiki to wmf.20 to bootstrap (duration: 35m 27s) |
[production] |
| 17:49 |
<demon@tin> |
Started scap: testwiki to wmf.20 to bootstrap |
[production] |
| 17:49 |
<demon@tin> |
Pruned MediaWiki: 1.29.0-wmf.17 [keeping static files] (duration: 00m 16s) |
[production] |
| 17:41 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Initial Scap3 config deploy - T116335 (duration: 10m 39s) |
[production] |
| 17:30 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Initial Scap3 config deploy - T116335 |
[production] |
| 17:23 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1093 (duration: 00m 57s) |
[production] |
| 17:14 |
<switchdc> |
(oblivian@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed |
[production] |
| 17:08 |
<mobrovac> |
restbase enabling back puppet for T116335 |
[production] |
| 17:07 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy, take 2 - T116335 (duration: 02m 12s) |
[production] |
| 17:06 |
<switchdc> |
(oblivian@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches |
[production] |
| 17:06 |
<marostegui> |
Deploy unscheduled alter table on db1044 (s3, image table) - T160415 |
[production] |
| 17:05 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy, take 2 - T116335 |
[production] |
| 17:05 |
<ppchelko@tin> |
Finished deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001, attempt#2 T160764 (duration: 03m 22s) |
[production] |
| 17:04 |
<marostegui> |
Deploy unscheduled alter table on db1015 (s3, image table) - T160415 |
[production] |
| 17:02 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy, take 2 - T116335 (duration: 00m 58s) |
[production] |
| 17:02 |
<marostegui> |
Deploy unscheduled alter table on db1038 (s3, image table) - T160415 |
[production] |
| 17:02 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: nope, no wmf.19 for donatewiki. life is hard |
[production] |
| 17:01 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy, take 2 - T116335 |
[production] |
| 17:01 |
<ppchelko@tin> |
Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001, attempt#2 T160764 |
[production] |
| 17:00 |
<marostegui> |
Deploy unscheduled alter table on db1035 (s3, image table) - T160415 |
[production] |
| 16:58 |
<marostegui> |
Deploy unscheduled alter table on db1077 (s3, image table) - T160415 |
[production] |
| 16:56 |
<marostegui> |
Deploy unscheduled alter table on db1078 (s3, image table) - T160415 |
[production] |
| 16:54 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: donatewiki back to wmf.19. you put your left foot in, you put your left foot out... |
[production] |
| 16:48 |
<marostegui> |
Deploy unscheduled alter table on db1093 (adding pl_from index) |
[production] |
| 16:45 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1093 (duration: 00m 42s) |
[production] |
| 16:43 |
<switchdc> |
(oblivian@sarin) END TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Successfully completed |
[production] |
| 16:43 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 (duration: 01m 33s) |
[production] |
| 16:42 |
<ppchelko@tin> |
Finished deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 (duration: 04m 28s) |
[production] |
| 16:41 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 |
[production] |
| 16:40 |
<switchdc> |
(oblivian@sarin) START TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Switch traffic flow to the appservers in the new datacenter |
[production] |
| 16:37 |
<ppchelko@tin> |
Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 |
[production] |
| 16:37 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: donatewiki still busted |
[production] |
| 16:35 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: donatewiki back to wmf.19 |
[production] |
| 16:33 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 (duration: 01m 04s) |
[production] |
| 16:32 |
<switchdc> |
(oblivian@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed |
[production] |
| 16:32 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 |
[production] |
| 16:28 |
<mobrovac> |
restbase disabling puppet for T116335 |
[production] |
| 16:27 |
<demon@tin> |
Synchronized README: no-op, co-master sync (duration: 00m 43s) |
[production] |
| 16:24 |
<switchdc> |
(oblivian@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches |
[production] |
| 16:11 |
<switchdc> |
(volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed |
[production] |
| 16:08 |
<switchdc> |
(volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches |
[production] |
| 16:08 |
<volans> |
testing the codfw caches wipe+warm, take 2 |
[production] |
| 16:04 |
<demon@tin> |
Synchronized scap/plugins/clean.py: syncing to both masters (duration: 00m 44s) |
[production] |
| 15:56 |
<switchdc> |
(volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Failed to execute |
[production] |
| 15:54 |
<switchdc> |
(volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches |
[production] |
| 15:53 |
<volans> |
testing the codfw caches wipe+warm: https://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_4.1_-_Wipe_caches T160178 |
[production] |