|
2019-02-07
§
|
| 08:53 |
<marostegui> |
Deploy schema change on s7 codfw master (db2047), this will generate lag on s7 codfw - T210713 |
[production] |
| 08:34 |
<godog> |
swift codfw-prod: more weight to ms-be2047 - T209395 T209921 |
[production] |
| 08:14 |
<marostegui> |
Deploy schema change on s4 primary master (db1068) - T210713 |
[production] |
| 08:13 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1081 (duration: 00m 54s) |
[production] |
| 07:50 |
<marostegui> |
Deploy schema change on db1081 |
[production] |
| 07:49 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1081 (duration: 00m 53s) |
[production] |
| 07:48 |
<reedy@deploy1001> |
Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 20s) |
[production] |
| 07:43 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1084 (duration: 00m 53s) |
[production] |
| 07:42 |
<reedy@deploy1001> |
Synchronized dblists/: Wikimania T215486 (duration: 00m 54s) |
[production] |
| 07:03 |
<marostegui> |
Deploy schema change on db1084 - T210713 |
[production] |
| 07:03 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1084 (duration: 00m 55s) |
[production] |
| 06:48 |
<marostegui> |
Restore consistency options on db2051 |
[production] |
| 06:14 |
<marostegui> |
Ease consistency options on db2051 (s4 master) to let it catch up on replication |
[production] |
| 04:35 |
<tstarling@deploy1001> |
Synchronized wmf-config/set-time-limit.php: (no justification provided) (duration: 00m 54s) |
[production] |
| 04:00 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Disable EP namespaces on wikis with no EP pages (duration: 00m 57s) |
[production] |
| 01:31 |
<eileen> |
civicrm revision changed from c5aec3ae76 to 08be00e87f, config revision is 306b4de48f |
[production] |
| 01:24 |
<eileen> |
civicrm revision changed from 6161a021c0 to c5aec3ae76, config revision is 306b4de48f |
[production] |
| 01:05 |
<twentyafterfour> |
US Evening SWAT is complete |
[production] |
| 01:04 |
<twentyafterfour> |
no phabricator deployment tonight |
[production] |
| 01:04 |
<eileen> |
civicrm revision changed from 613b388916 to 6161a021c0, config revision is 306b4de48f |
[production] |
| 00:56 |
<twentyafterfour@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT config change for Bug: T214003 (duration: 00m 53s) |
[production] |
| 00:53 |
<twentyafterfour@deploy1001> |
Synchronized php-1.33.0-wmf.16/extensions/VisualEditor/: SWAT f89e12fc466d2c51343d9815c70a0b4602acc333 to fix bug: T209610 (duration: 00m 55s) |
[production] |
| 00:48 |
<twentyafterfour@deploy1001> |
Synchronized php-1.33.0-wmf.16/extensions/MobileFrontend/: SWAT dd8654ac9b3f2e88241e65d3ea35aea9699defc5 (duration: 01m 00s) |
[production] |
| 00:47 |
<twentyafterfour> |
syncing commit dd8654ac9b3f2e88241e65d3ea35aea9699defc5 for Bug: T209052 |
[production] |
| 00:24 |
<twentyafterfour> |
running `mwscript migrateUserGroup.php commonswiki extended-uploader autopatrolled` on deploy1001 |
[production] |
|
2019-02-06
§
|
| 23:58 |
<mutante> |
restarting icinga on icinga1001 to pick up new check command ? |
[production] |
| 22:22 |
<twentyafterfour@deploy1001> |
Synchronized php: group1 wikis to 1.33.0-wmf.16 refs T206670 (duration: 00m 53s) |
[production] |
| 22:21 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.16 refs T206670 |
[production] |
| 21:45 |
<mutante> |
LDAP - adding brennen to wmf, releng, ciadmin - Welcome Brennan Bearnes, Software Engineer in Release Engineering (T215365 T214556) |
[production] |
| 21:05 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 (duration: 03m 43s) |
[production] |
| 21:04 |
<Krinkle> |
krinkle@webperf1001 Kill xenon-log (pid 449). It seems its Redis TCP socket to mwlog1001 has been stuck since Dec 13, causing the process to indefinitely hang on listen()/socket.recv() |
[production] |
| 21:01 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 |
[production] |
| 20:49 |
<mutante> |
LDAP - adding h78na to wmf - welcome Hana Worku, developer on the multimedia team (T215352) |
[production] |
| 20:40 |
<mutante> |
LDAP - adding egardner to wmf - welcome Eric Gardner , software engineer in Audiences (T214654) |
[production] |
| 20:35 |
<twentyafterfour> |
1.33.0-wmf.16 has a significantly higher rate of "entire web request took longer than 60 seconds and timed out" |
[production] |
| 20:25 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.33.0-wmf.16 refs T206670 |
[production] |
| 20:03 |
<twentyafterfour> |
Resuming the MediaWiki train for version 1.33.0-wmf.16. Will deploy Group0 wikis first and then catch up to group1 after a few minutes monitoring logs for stability. |
[production] |
| 19:50 |
<robh> |
updated firmware on cp4026 and re-seated (already well seated) dimm b3. errors have cleared for now T214516 |
[production] |
| 19:24 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@cd413dd]: Small bug fix for history checker (duration: 12m 45s) |
[production] |
| 19:13 |
<robh> |
taking cp4026 offline to flash firmware and reseat dimm for testing on T214516 |
[production] |
| 19:12 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@cd413dd]: Small bug fix for history checker |
[production] |
| 19:11 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) cobalt T214326 (duration: 00m 09s) |
[production] |
| 19:11 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) cobalt T214326 |
[production] |
| 19:09 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) gerrit2001 first (duration: 00m 10s) |
[production] |
| 19:09 |
<mutante> |
LDAP - adding afandian2 and toddleroux to nda (T214727) |
[production] |
| 19:09 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) gerrit2001 first |
[production] |
| 19:04 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.16/extensions/Flow/includes/Conversion/Utils.php: I405dd193 Update Parsoid Accept header to 2.0.0 so service can deploy (duration: 00m 54s) |
[production] |
| 19:03 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.14/extensions/Flow/includes/Conversion/Utils.php: I405dd193 Update Parsoid Accept header to 2.0.0 so service can deploy (duration: 00m 56s) |
[production] |
| 18:03 |
<thcipriani@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:486536|Removed namespace Коментар, added namespace Портал on srwikinews]] T214561 T214563 (duration: 00m 53s) |
[production] |
| 18:01 |
<mutante> |
LDAP - adding alaasarhan to wmde (T215066) |
[production] |