1251-1300 of 10000 results (57ms)
2022-06-02 ยง
15:49 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 10:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
15:23 <moritzm> installing cups security updates (client-side libs only) [production]
15:15 <moritzm> installing openssl security updates on stretch [production]
15:14 <herron@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-logging-codfw cluster: Roll restart of jvm daemons. [production]
15:12 <mutante> gitlab migration to new hardware in progress [production]
15:06 <jelto> start migration to gitlab1004 - T307142 [production]
14:59 <bking@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: restart to enable S3 plugin - bking@cumin1001 - T309720 [production]
14:56 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
14:56 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 10:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
14:14 <herron@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-logging-codfw cluster: Roll restart of jvm daemons. [production]
13:57 <joal@deploy1002> Finished deploy [airflow-dags/analytics@2ad442e]: (no justification provided) (duration: 00m 08s) [production]
13:57 <joal@deploy1002> Started deploy [airflow-dags/analytics@2ad442e]: (no justification provided) [production]
13:44 <urandom> ALTER-ing system_auth replication strategy, AQS Cassandra cluster -- T307641 [production]
13:34 <hashar@deploy1002> Finished deploy [integration/docroot@b55f30e]: build: Updating eslint-config-wikimedia to 0.22.1 (duration: 00m 08s) [production]
13:34 <hashar@deploy1002> Started deploy [integration/docroot@b55f30e]: build: Updating eslint-config-wikimedia to 0.22.1 [production]
13:29 <urbanecm> UTC afternoon B&C window done [production]
13:25 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 3c12e779707e3982f973641e2b9c2522a429830f: Launch DiscussionTools topic subscriptions a/b test (T304029) (duration: 03m 16s) [production]
13:23 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:22 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:22 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:21 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:19 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 806b8367e3c91a2b6b0dd76cdc66e041199ae834: Enable DiscussionTools automatic topic subscriptions as beta feature on remaining wikis (T295425) (duration: 03m 21s) [production]
13:19 <hashar> Restarting Gerrit [production]
13:16 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:15 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:15 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:14 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:09 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 192c5356e1fb21ba820615085abcb2185fd1864c: itwikiversity: Correct typo of "markbotedits" (T309750) (duration: 03m 13s) [production]
13:08 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:08 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:08 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:05 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
12:15 <joal@deploy1002> Finished deploy [airflow-dags/analytics@19b943d]: (no justification provided) (duration: 00m 09s) [production]
12:15 <joal@deploy1002> Started deploy [airflow-dags/analytics@19b943d]: (no justification provided) [production]
12:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Give more weight to db1137 in x1 to test 10.6.8 T309679 ', diff saved to https://phabricator.wikimedia.org/P29343 and previous config saved to /var/cache/conftool/dbconfig/20220602-120320-marostegui.json [production]
11:44 <moritzm> installing python-pip bugfix updates from bullseye point release [production]
11:40 <moritzm> installing tasksel updates from bullseye point release [production]
11:31 <hashar> Restarted Gerrit on replica gerrit2001 [production]
11:23 <moritzm> installing sysvinit-utils bugfix updates from last bullseye point release [production]
11:03 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
11:03 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:51 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:51 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:40 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:39 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:28 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:28 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:14 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
10:14 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]