2401-2450 of 10000 results (30ms)
2020-05-26 §
11:06 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:598509|[nnwiki] Change category collation to (T253559)]] (duration: 01m 10s) [production]
10:46 <marostegui> Stop tendril's event scheduler [production]
10:18 <jynus> stop db2097 for hw maintenance T252492 [production]
09:48 <vgutierrez> rolling upgrade to ats 8.0.7-1wm11 [production]
09:41 <_joe_> all jobrunners converted to use envoy for TLS termination [production]
09:38 <oblivian@cumin1001> conftool action : set/weight=10; selector: name=mw131[0-1].eqiad.wmnet [production]
09:38 <oblivian@cumin1001> conftool action : set/weight=10; selector: name=mw133[4-8].eqiad.wmnet [production]
09:37 <oblivian@cumin1001> conftool action : set/weight=10; selector: name=mw130[0-9].eqiad.wmnet [production]
09:37 <oblivian@cumin1001> conftool action : set/weight=10; selector: name=mw130[0-3].eqiad.wmnet [production]
09:36 <oblivian@cumin1001> conftool action : set/weight=10:pooled=yes; selector: name=mw129[3-9].eqiad.wmnet [production]
09:30 <oblivian@cumin1001> conftool action : set/weight=1:pooled=yes; selector: name=mw130[0-3].eqiad.wmnet [production]
09:27 <oblivian@cumin1001> conftool action : set/weight=1:pooled=yes; selector: name=mw130[4-7].eqiad.wmnet [production]
09:22 <gehel> repool wdqs1007, catched up on lag [production]
09:09 <oblivian@cumin1001> conftool action : set/weight=1:pooled=yes; selector: name=mw13(0[89]|1[01]).eqiad.wmnet [production]
09:02 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
09:02 <mutante> decom'ing people1001 - replaced by people1002 [production]
09:01 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
09:01 <oblivian@cumin1001> conftool action : set/weight=1:pooled=yes; selector: name=mw13(1|3)8.eqiad.wmnet [production]
08:57 <oblivian@cumin1001> conftool action : set/weight=1:pooled=yes; selector: name=mw133[4-7].eqiad.wmnet [production]
08:55 <_joe_> progressively converting jobrunners to envoy [production]
08:41 <oblivian@cumin1001> conftool action : set/weight=1:pooled=yes; selector: name=mw1337.eqiad.wmnet [production]
07:20 <moritzm> installing libssh security updates [production]
07:03 <vgutierrez> upgrade to ats 8.0.7-1wm11 on cp3064 and cp3065 [production]
06:49 <marostegui> Deploy schema change on s3 directly on the master with 1 minute sleep in between wikis T253342 [production]
06:47 <marostegui> Deploy schema change on s1 directly on the master T253342 [production]
06:44 <marostegui> Deploy schema change on s4 directly on the master T253342 [production]
06:35 <XioNoX> reboot scs-ulsfo - T253609 [production]
06:29 <marostegui> Deploy schema change on s7 directly on the master T253342 [production]
06:24 <marostegui> Deploy schema change on s8 directly on the master T253342 [production]
06:01 <marostegui> Deploy schema change on s2 directly on the master T253342 [production]
04:35 <marostegui> Repool labsdb1011 - T249188 [production]
04:13 <marostegui> Stop slaves and stop mysql on labsdb1011 T249188 [production]
03:55 <tstarling@deploy1001> Synchronized php-1.35.0-wmf.31/includes/export/XmlDumpWriter.php: T253468 (duration: 01m 06s) [production]
03:53 <tstarling@deploy1001> Synchronized php-1.35.0-wmf.32/includes/export/XmlDumpWriter.php: T253468 (duration: 01m 07s) [production]
03:20 <tstarling@deploy1001> Synchronized php-1.35.0-wmf.32/includes/specials/SpecialChangeContentModel.php: for UBN T252963 (duration: 01m 07s) [production]
03:18 <tstarling@deploy1001> sync-file aborted: (no justification provided) (duration: 00m 32s) [production]
2020-05-25 §
23:34 <ejegg> re-enabled fundraising queue consumers and job runners, except audits, dedupe, and recurring [production]
21:38 <eileen> civicrm revision changed from 5428c5c449 to d1cd99166f, config revision is 6b05d6bb25 [production]
21:18 <eileen> civicrm revision is 7380e0e8ce, config revision is 6b05d6bb25 [production]
21:01 <ejegg> updated fundraising CiviCRM from 737d88a5ee to 7380e0e8ce [production]
17:17 <ejegg> updated fundraising CiviCRM from 6b1d5902dd to 737d88a5ee [production]
17:09 <ejegg> enabled contribution tracking queue on payments-wiki [production]
16:24 <ejegg> updated standalone SmashPig from 2702b04329 to 44690f761c [production]
16:17 <jayme@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'mathoid' for release 'staging' . [production]
16:16 <XioNoX> enable IX4/6 BGP group on cr4-ulsfo - T237575 [production]
16:00 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
15:55 <XioNoX> disable IX4/6 BGP group on cr4-ulsfo - T237575 [production]
15:17 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
15:15 <ejegg> updated payments-wiki from 3c465cb11c to d11efeb1cf, put it into maintenance mode [production]
15:15 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]