|
2016-09-08
ยง
|
| 20:47 |
<gehel> |
redeploy wdqs on wdqs2001.codfw.wmnet |
[production] |
| 20:03 |
<demon@tin> |
Synchronized php-1.28.0-wmf.18/extensions/Echo/includes/SeenTime.php: Trying to stop some duplicate redis fetches (duration: 00m 52s) |
[production] |
| 20:00 |
<hashar> |
nova delete ci-jessie-wikimedia-369422 (was stuck in deleting state) |
[releng] |
| 19:57 |
<bblack> |
repooling normal traffic to cache_upload in ulsfo |
[production] |
| 19:49 |
<hashar> |
Nodepool, deleting instances that Nodepool lost track of (from nodepool alien-list) |
[releng] |
| 19:47 |
<hashar> |
nodepool cant delete: ci-jessie-wikimedia-369422 [ delete | 2.24 hours . Stuck in task_state=deleting :( |
[releng] |
| 19:46 |
<hashar> |
Nodepool looping over some tasks since 17:45 ( https://grafana.wikimedia.org/dashboard/db/nodepool?panelId=21&fullscreen ) |
[releng] |
| 19:26 |
<legoktm> |
repooled integration-slave-jessie-1005 now that php7 testing is done |
[releng] |
| 19:19 |
<hashar> |
integration: salt -v '*' cmd.run 'cd /srv/deployment/integration/slave-scripts; git pull' | https://gerrit.wikimedia.org/r/308931 |
[releng] |
| 19:12 |
<hashar> |
integration: salt -v '*' cmd.run 'cd /srv/deployment/integration/slave-scripts; git pull' | https://gerrit.wikimedia.org/r/309272 |
[releng] |
| 19:02 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group2 to wmf.18 |
[production] |
| 18:23 |
<demon@tin> |
Synchronized multiversion/: So much junk to remove (duration: 01m 06s) |
[production] |
| 17:58 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase200[1-9]-b.codfw.wmnet |
[production] |
| 17:53 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1013-b.eqiad.wmnet |
[production] |
| 17:53 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1012-b.eqiad.wmnet |
[production] |
| 17:53 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1008-b.eqiad.wmnet |
[production] |
| 17:46 |
<chasemp> |
reboot labstore1004 & labstore1005 |
[production] |
| 17:45 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1011-b.eqiad.wmnet |
[production] |
| 17:45 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1010-b.eqiad.wmnet |
[production] |
| 17:45 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1007-b.eqiad.wmnet |
[production] |
| 17:41 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1015-a.eqiad.wmnet |
[production] |
| 17:41 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1014-a.eqiad.wmnet |
[production] |
| 17:41 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1009-a.eqiad.wmnet |
[production] |
| 17:11 |
<gehel> |
reverting deploying new LVS configuration for kartotherian.svc.eqiad.wmnet - puppet error, let's analyse slowly... |
[production] |
| 17:11 |
<bd808> |
Added BryanDavis (self) to project as admin |
[toolsbeta] |
| 17:08 |
<legoktm> |
deleted integration-jessie-lego-test01 |
[releng] |
| 17:06 |
<gehel> |
deploying new LVS configuration for kartotherian.svc.eqiad.wmnet |
[production] |
| 17:04 |
<bd808> |
Updated Striker to 7d7c8ee |
[production] |
| 16:55 |
<demon@tin> |
Synchronized multiversion/: removing more junk - getMWVersion (duration: 01m 07s) |
[production] |
| 16:50 |
<legoktm> |
deleted integration-aptly01 |
[releng] |
| 16:47 |
<demon@tin> |
Finished scap: removing obsolete p symlink (duration: 04m 25s) |
[production] |
| 16:43 |
<demon@tin> |
Started scap: removing obsolete p symlink |
[production] |
| 16:13 |
<godog> |
roll-restart cassandra instances on restbase-test cluster T143044 |
[production] |
| 16:07 |
<moritzm> |
uploaded linux-meta 1.10 to carbon (pointing to the new 4.4.19 kernel image) |
[production] |
| 15:37 |
<ottomata> |
deploying refinery with v0.0.35 of refinery source |
[analytics] |
| 14:48 |
<addshore@tin> |
Finished scap: SWAT: [[gerrit:309308|Update jquery.uls from upstream]] (duration: 50m 36s) |
[production] |
| 14:41 |
<gehel> |
deploying new DNS entries for kartotherian.svc.eqiad.wmnet |
[production] |
| 14:36 |
<godog> |
bounce restbase-test2001 cassandra-a instance T143044 |
[production] |
| 13:57 |
<addshore@tin> |
Started scap: SWAT: [[gerrit:309308|Update jquery.uls from upstream]] |
[production] |
| 13:43 |
<moritzm> |
powering down mw2075-mw2079 for hardware maintenance (T142726) |
[production] |
| 13:28 |
<ema> |
upgrading cache_upload ulsfo to varnish 4, dns depooled T131502 |
[production] |
| 13:15 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:304608|Enable mention status notifications everywhere]] (duration: 00m 47s) |
[production] |
| 13:12 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:309047|Add massmessage-sender group to urwiki]] (duration: 00m 47s) |
[production] |
| 13:08 |
<addshore@tin> |
Synchronized wmf-config/extension-list: SWAT: [[gerrit:309287|RESTBaseUpdateJobs: Un-deploy the extension]] 3/3 (duration: 00m 47s) |
[production] |
| 13:07 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:309287|RESTBaseUpdateJobs: Un-deploy the extension]] 2/3 (duration: 00m 46s) |
[production] |
| 13:06 |
<addshore@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:309287|RESTBaseUpdateJobs: Un-deploy the extension]] 1/3 (duration: 00m 49s) |
[production] |
| 12:52 |
<gehel> |
redeploying wdqs on wdqs2002.codfw.wmnet - T144380 |
[production] |
| 12:44 |
<moritzm> |
uploaded new linux package for jessie (based on 4.4.19 with bumped kernel ABI=2) |
[production] |
| 12:37 |
<paladox> |
apply https://gerrit.wikimedia.org/r/#/c/309297/ |
[tools.lolrrit-wm] |
| 11:35 |
<moritzm> |
reimaging mw2161, mw2162, mw2081, mw2082 to jessie |
[production] |