|
2019-09-18
ยง
|
| 19:08 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 19:07 |
<twentyafterfour> |
There appear to be no blockers on T220748 so I'll proceed with deploying 1.34.0-wmf.23 to group 1. |
[production] |
| 19:01 |
<joal@deploy1001> |
Finished deploy [analytics/aqs/deploy@5b011d1]: Regular deploy - analytics weekly train - Retry after fix (duration: 02m 12s) |
[production] |
| 18:59 |
<joal@deploy1001> |
Started deploy [analytics/aqs/deploy@5b011d1]: Regular deploy - analytics weekly train - Retry after fix |
[production] |
| 18:55 |
<joal@deploy1001> |
Finished deploy [analytics/aqs/deploy@5b011d1]: Regular deploy - analytics weekly train (duration: 01m 05s) |
[production] |
| 18:54 |
<joal@deploy1001> |
Started deploy [analytics/aqs/deploy@5b011d1]: Regular deploy - analytics weekly train |
[production] |
| 18:46 |
<XioNoX> |
remove `border-in4 term ddos-0906` from all routers |
[production] |
| 17:53 |
<Amir1> |
Creating hiwikisource is done |
[production] |
| 17:50 |
<urandom> |
decommissioning Cassandra, restbase2012-b -- T224553 |
[production] |
| 17:48 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 32s) |
[production] |
| 17:45 |
<ladsgroup@deploy1001> |
Synchronized static/images/project-logos/: Add hiwikisource logos (T218155) (duration: 01m 04s) |
[production] |
| 17:43 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/VariantSettings.php: Add hiwikisource (T218155) (duration: 01m 05s) |
[production] |
| 17:40 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Add hiwikisource (T218155) (duration: 01m 04s) |
[production] |
| 17:38 |
<Amir1> |
manual write on hiwikisource "wikiadmin@10.64.0.205(hiwikisource)> update text set old_text = 'DB://cluster25/1';" (T218155) |
[production] |
| 17:33 |
<Amir1> |
mwscript maintenance/createAndPromote.php --wiki=hiwikisource --force --sysop Ladsgroup (T218155) |
[production] |
| 17:28 |
<ladsgroup@deploy1001> |
rebuilt and synchronized wikiversions files: (no justification provided) |
[production] |
| 17:22 |
<ladsgroup@deploy1001> |
Synchronized dblists: (no justification provided) (duration: 01m 06s) |
[production] |
| 17:22 |
<Jeff_Green> |
authdns-update to deploy DNS for new fundraising host |
[production] |
| 17:03 |
<mutante> |
ganeti2004 - resetting DRAC in an attempt to make IPMI work again |
[production] |
| 17:00 |
<Urbanecm> |
Morning SWAT done |
[production] |
| 16:48 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: [[:gerrit:537691|Enable DNS blacklist on testwiki temporarily]] (T230822) (duration: 01m 03s) |
[production] |
| 16:43 |
<Urbanecm> |
8340be9 sync is for T230822, mistakenly inserted `test` instead of the task number |
[production] |
| 16:42 |
<@> |
helmfile [CODFW] Ran 'apply' command on namespace 'sessionstore' for release 'production' . |
[production] |
| 16:42 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 8340be9: Enable logging for BlockManager channel at info level (test) (duration: 01m 04s) |
[production] |
| 16:36 |
<@> |
helmfile [EQIAD] Ran 'apply' command on namespace 'sessionstore' for release 'production' . |
[production] |
| 16:35 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: dc1298d: Add Draft and Draft_talk aliases for wikis that define draft namespace (T223472) (duration: 01m 02s) |
[production] |
| 16:31 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 6e59651: Disable FundraiserLandingPage extension on test.wikipedia.org (T203020) (duration: 01m 04s) |
[production] |
| 16:26 |
<Urbanecm> |
Purge https://en.wikipedia.org/static/images/project-logos/tewikisource.png (T232065) |
[production] |
| 16:25 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 7c987fc: Change Telugu Wikisource Logo (T232065; 2/2) (duration: 01m 06s) |
[production] |
| 16:24 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: 7c987fc: Change Telugu Wikisource Logo (T232065; 1/2) (duration: 01m 05s) |
[production] |
| 16:18 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 817d679: Turn on EventLogging at 100% for DonateWiki (T233145) (duration: 01m 04s) |
[production] |
| 16:05 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: ba30276: Add suppressredirect right to filemovers on bnwiki (T233137) (duration: 01m 05s) |
[production] |
| 15:55 |
<moritzm> |
repooling restbase2011 after reimage/bootstrap |
[production] |
| 15:53 |
<urandom> |
decommissioning Cassandra, restbase2012-a -- T224553 |
[production] |
| 15:06 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 14:59 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: service=restbase-backend |
[production] |
| 14:21 |
<elukey@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 14:16 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:52 |
<@> |
helmfile [CODFW] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 13:50 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'wikifeeds' for release 'staging' . |
[production] |
| 13:41 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@ca30c4e]: Regular analytics weekly train (duration: 05m 28s) |
[production] |
| 13:40 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:38 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:36 |
<joal@deploy1001> |
Started deploy [analytics/refinery@ca30c4e]: Regular analytics weekly train |
[production] |
| 13:26 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:23 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:11 |
<hashar> |
Restarting Jenkins, starting Zuul |
[production] |
| 12:56 |
<marostegui> |
Deploy schema change on the following s6 hosts: db1088, db1093, db1096, db1098, db1139, dbstore1005 - T231172 |
[production] |
| 12:52 |
<hashar> |
gracefully stopping Zuul (kill SIGUSR1) to prepare for Jenkins restart |
[production] |
| 12:40 |
<marostegui> |
Deploy schema change on s6 codfw master with replication T231172 |
[production] |