2501-2550 of 10000 results (83ms)
2023-05-03 §
05:39 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 0:15:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 [production]
01:24 <eileen> civicrm upgraded from 09d2eefd to c6149ad2 [production]
00:58 <ejegg> civicrm upgraded from 8426761b to 09d2eefd [production]
00:47 <sukhe> restart haproxy on cp2031: T334448 [production]
00:42 <eileen> civicrm upgraded from 8076995a to 8426761b [production]
2023-05-02 §
23:28 <eileen> config revision changed from 18acbe1a to 69f60bb9 [production]
22:56 <eileen> config revision changed from 2eef4039 to 18acbe1a [production]
22:53 <eileen> civicrm upgraded from a3d84de3 to 8076995a [production]
20:36 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] (duration: 06m 55s) [production]
20:30 <akosiaris@deploy1002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
20:30 <akosiaris@deploy1002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
20:29 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] [production]
20:25 <ebernhardson@deploy1002> Finished deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 (duration: 00m 28s) [production]
20:24 <ebernhardson@deploy1002> Started deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 [production]
20:20 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] (duration: 15m 47s) [production]
20:06 <urbanecm@deploy1002> urbanecm and iniquity: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
20:04 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] [production]
19:40 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_codfw [production]
19:40 <bking@cumin1001> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_codfw [production]
19:28 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:28 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:18 <bking@deploy1002> Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 05s) [production]
19:18 <bking@deploy1002> Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) [production]
19:13 <bking@deploy1002> Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 16s) [production]
19:12 <bking@deploy1002> Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) [production]
19:12 <bking@deploy1002> Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 07m 13s) [production]
19:05 <bking@deploy1002> Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) [production]
19:04 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on wdqs2022.codfw.wmnet with reason: attempting WDQS stack on bullseye [production]
19:04 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on wdqs2022.codfw.wmnet with reason: attempting WDQS stack on bullseye [production]
18:56 <bking@deploy1002> Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 03s) [production]
18:56 <bking@deploy1002> Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) [production]
18:56 <bking@deploy1002> Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 19s) [production]
18:55 <bking@deploy1002> Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) [production]
18:50 <bking@cumin1001> conftool action : set/pooled=inactive; selector: name=wdqs2022.codfw.wmnet [production]
18:38 <ejegg> civicrm upgraded from e7904ea6 to a3d84de3 [production]
18:19 <milimetric@deploy1002> Finished deploy [analytics/refinery@c42021f] (thin): Regular analytics weekly train THIN [analytics/refinery@c42021f] (duration: 00m 07s) [production]
18:19 <milimetric@deploy1002> Started deploy [analytics/refinery@c42021f] (thin): Regular analytics weekly train THIN [analytics/refinery@c42021f] [production]
18:11 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.7 refs T330213 [production]
18:03 <brennen> train 1.41.0-wmf.7 (T330213): (correction: group0 today) [production]
18:01 <brennen> train 1.41.0-wmf.7 (T330213): no current blockers, rolling to group1 with `scap train` [production]
17:45 <milimetric@deploy1002> Finished deploy [analytics/refinery@c42021f]: Regular analytics weekly train [analytics/refinery@c42021f] (duration: 06m 26s) [production]
17:39 <milimetric@deploy1002> Started deploy [analytics/refinery@c42021f]: Regular analytics weekly train [analytics/refinery@c42021f] [production]
17:36 <sukhe> cr*-eqiad: delete backup routes for ns0: delete routing-options static route 208.80.153.231/32: T330670 [production]
17:34 <sukhe> [correction] cr*-codfw: delete backup routes for ns0: delete routing-options static route 208.80.154.238/32: T330670 [production]
17:32 <sukhe> cr*-codfw: delete backup routes for ns1: delete routing-options static route 208.80.154.238/32: T330670 [production]
17:28 <sukhe> ns1 set routing-options static route 208.80.153.231/32 next-hop [ 208.80.153.77 208.80.153.111 208.80.153.10 ]: T330670 [production]
17:25 <sukhe> ns0 set routing-options static route 208.80.154.238/32 next-hop [ 208.80.154.10 208.80.155.108 208.80.154.134 ]: T330670 [production]
17:03 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1001.eqiad.wmnet [production]
16:58 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host sretest1001.eqiad.wmnet [production]
16:38 <btullis@cumin1001> END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. [production]