2017-04-11
ยง
|
17:05 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy, take 2 - T116335 |
[production] |
17:05 |
<ppchelko@tin> |
Finished deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001, attempt#2 T160764 (duration: 03m 22s) |
[production] |
17:04 |
<marostegui> |
Deploy unscheduled alter table on db1015 (s3, image table) - T160415 |
[production] |
17:02 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy, take 2 - T116335 (duration: 00m 58s) |
[production] |
17:02 |
<marostegui> |
Deploy unscheduled alter table on db1038 (s3, image table) - T160415 |
[production] |
17:02 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: nope, no wmf.19 for donatewiki. life is hard |
[production] |
17:01 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy, take 2 - T116335 |
[production] |
17:01 |
<ppchelko@tin> |
Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001, attempt#2 T160764 |
[production] |
17:00 |
<marostegui> |
Deploy unscheduled alter table on db1035 (s3, image table) - T160415 |
[production] |
16:58 |
<marostegui> |
Deploy unscheduled alter table on db1077 (s3, image table) - T160415 |
[production] |
16:56 |
<marostegui> |
Deploy unscheduled alter table on db1078 (s3, image table) - T160415 |
[production] |
16:54 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: donatewiki back to wmf.19. you put your left foot in, you put your left foot out... |
[production] |
16:48 |
<marostegui> |
Deploy unscheduled alter table on db1093 (adding pl_from index) |
[production] |
16:46 |
<andrewbogott> |
added exec nodes tools-exec-1430, 31, 32, 33, 34. |
[tools] |
16:45 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1093 (duration: 00m 42s) |
[production] |
16:43 |
<switchdc> |
(oblivian@sarin) END TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Successfully completed |
[production] |
16:43 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 (duration: 01m 33s) |
[production] |
16:42 |
<ppchelko@tin> |
Finished deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 (duration: 04m 28s) |
[production] |
16:41 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Staging: Initial Scap3 config deploy - T116335 |
[production] |
16:40 |
<switchdc> |
(oblivian@sarin) START TASK - switchdc.stages.t05_switch_traffic(eqiad, codfw) Switch traffic flow to the appservers in the new datacenter |
[production] |
16:37 |
<ppchelko@tin> |
Started deploy [electron-render/deploy@5492cdb]: Update to latest upstream, canary on scb2001 T160764 |
[production] |
16:37 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: donatewiki still busted |
[production] |
16:35 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: donatewiki back to wmf.19 |
[production] |
16:33 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 (duration: 01m 04s) |
[production] |
16:32 |
<switchdc> |
(oblivian@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed |
[production] |
16:32 |
<mobrovac@tin> |
Started deploy [restbase/deploy@e470b9f]: Dev Cluster: Initial Scap3 config deploy - T116335 |
[production] |
16:28 |
<mobrovac> |
restbase disabling puppet for T116335 |
[production] |
16:27 |
<demon@tin> |
Synchronized README: no-op, co-master sync (duration: 00m 43s) |
[production] |
16:24 |
<switchdc> |
(oblivian@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches |
[production] |
16:11 |
<switchdc> |
(volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Successfully completed |
[production] |
16:08 |
<switchdc> |
(volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches |
[production] |
16:08 |
<volans> |
testing the codfw caches wipe+warm, take 2 |
[production] |
16:04 |
<demon@tin> |
Synchronized scap/plugins/clean.py: syncing to both masters (duration: 00m 44s) |
[production] |
15:59 |
<hashar> |
integration-config-tox-jessie job is broken due to the JJB upgrade |
[releng] |
15:56 |
<switchdc> |
(volans@sarin) END TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) Failed to execute |
[production] |
15:54 |
<switchdc> |
(volans@sarin) START TASK - switchdc.stages.t04_cache_wipe(eqiad, codfw) wipe and warmup caches |
[production] |
15:53 |
<volans> |
testing the codfw caches wipe+warm: https://wikitech.wikimedia.org/wiki/Switch_Datacenter#Phase_4.1_-_Wipe_caches T160178 |
[production] |
15:40 |
<hashar> |
Upgraded JJB to latest master 4f77324f with a couple cherrypicks on top of that. 022738f8...edebce7f T162674 |
[releng] |
15:36 |
<hashar> |
Updating selenium-* jobs configuration for the performance plugin due to JJB upgrade T162674 |
[releng] |
15:25 |
<thcipriani@tin> |
Synchronized README: test sync for new scap version 3.5.5 (duration: 00m 59s) |
[production] |
15:23 |
<hashar> |
Adding parameter ZUUL_VOTING to all Jenkins jobs due to JJB upgrade T162674 |
[releng] |
15:19 |
<godog> |
upload scap 3.5.5-1 - T127762 |
[production] |
15:13 |
<hashar> |
Forced updated jenkins-job-builder 86478421...022738f8 - T162674 |
[releng] |
15:05 |
<ema> |
upgrade cp4005 (cache_upload) to linux 4.9 T162029 |
[production] |
14:31 |
<moritzm> |
powercycled restbase1007, stuck during reboot |
[production] |
14:18 |
<moritzm> |
upgrading restbase1007 to Linux 4.9 |
[production] |
14:15 |
<andrewbogott> |
emptied /srv/pbuilder to make space on tools-docker-04 |
[tools] |
13:55 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:343438|Enable RCFilters beta feature on fawiki, ruwiki, trwiki, and frwiki (T144458)]] (duration: 00m 39s) |
[production] |
13:54 |
<ottomata> |
reimaging stat1004 as jessie |
[production] |
13:53 |
<akosiaris> |
upgrade puppet agent to 3.8 across the jessie fleet. Do that in a stages, starting with parsoid hosts. move on to mw fleet next. T162462 |
[production] |