3551-3600 of 10000 results (23ms)
2023-04-18 §
00:28 <eevans@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on cassandra-dev2001.codfw.wmnet with reason: testing systemd unit changes — T327954 [production]
2023-04-17 §
13:47 <moritzm> installing mariadb-10.3 security updates (Debian packaged version, not the wmf-mariadb packages) [production]
06:27 <marostegui@cumin1001> dbctl commit (dc=all): 'db1214 (re)pooling @ 4%: Pooling db1214 T326669', diff saved to https://phabricator.wikimedia.org/P46940 and previous config saved to /var/cache/conftool/dbconfig/20230417-062749-root.json [production]
2023-04-13 §
21:10 <brennen@deploy2002> rebuilt and synchronized wikiversions files: all wikis to 1.41.0-wmf.4 refs T330210 [production]
20:15 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.41.0-wmf.3 refs T330210 [production]
19:55 <brennen@deploy2002> rebuilt and synchronized wikiversions files: all wikis to 1.41.0-wmf.4 refs T330210 [production]
19:03 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.41.0-wmf.3 refs T330210 [production]
18:34 <brennen@deploy2002> rebuilt and synchronized wikiversions files: all wikis to 1.41.0-wmf.4 refs T330210 [production]
14:20 <moritzm> installing mariadb-10.3 security updates (as shipped in Debian, not the wmf-mariadb packages) [production]
12:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1114 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P46668 and previous config saved to /var/cache/conftool/dbconfig/20230413-121001-root.json [production]
08:42 <marostegui@cumin1001> dbctl commit (dc=all): 'db1223 (re)pooling @ 4%: Pooling db1223 T326669', diff saved to https://phabricator.wikimedia.org/P46656 and previous config saved to /var/cache/conftool/dbconfig/20230413-084238-root.json [production]
07:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46637 and previous config saved to /var/cache/conftool/dbconfig/20230413-071000-root.json [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 4%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46636 and previous config saved to /var/cache/conftool/dbconfig/20230413-070428-root.json [production]
2023-04-12 §
18:16 <dancy@deploy2002> Synchronized php: group1 wikis to 1.41.0-wmf.4 refs T330210 (duration: 06m 02s) [production]
18:10 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.4 refs T330210 [production]
08:17 <hashar@deploy2002> Synchronized wmf-config/CommonSettings-labs.php: [Beta Cluster] Replicate WebResponseSetCookie wgHooks migration here too - T333926 (duration: 05m 51s) [production]
06:26 <marostegui@cumin1001> dbctl commit (dc=all): 'db1218 (re)pooling @ 4%: Pooling db1218 T326669', diff saved to https://phabricator.wikimedia.org/P46424 and previous config saved to /var/cache/conftool/dbconfig/20230412-062634-root.json [production]
06:12 <marostegui@cumin1001> dbctl commit (dc=all): 'db1222 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46421 and previous config saved to /var/cache/conftool/dbconfig/20230412-061248-root.json [production]
05:41 <krinkle@deploy2002> Synchronized php-1.41.0-wmf.4/includes/libs/objectcache/: Ie3a2215d33: disable WANCache cool-off feature (duration: 06m 00s) [production]
2023-04-11 §
18:38 <demon@deploy2002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.4 refs T330210 [production]
09:48 <marostegui@cumin1001> dbctl commit (dc=all): 'db1118 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46297 and previous config saved to /var/cache/conftool/dbconfig/20230411-094825-root.json [production]
07:51 <marostegui@cumin1001> dbctl commit (dc=all): 'db1211 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46276 and previous config saved to /var/cache/conftool/dbconfig/20230411-075155-root.json [production]
07:03 <marostegui@cumin1001> dbctl commit (dc=all): 'db1209 (re)pooling @ 4%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46261 and previous config saved to /var/cache/conftool/dbconfig/20230411-070310-root.json [production]
06:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db1224 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46256 and previous config saved to /var/cache/conftool/dbconfig/20230411-065452-root.json [production]
03:54 <mwpresync@deploy2002> Pruned MediaWiki: 1.41.0-wmf.2 (duration: 02m 15s) [production]
03:52 <mwpresync@deploy2002> Finished scap: testwikis wikis to 1.41.0-wmf.4 refs T330210 (duration: 49m 57s) [production]
03:02 <mwpresync@deploy2002> Started scap: testwikis wikis to 1.41.0-wmf.4 refs T330210 [production]
2023-04-10 §
18:16 <krinkle@deploy2002> Synchronized wmf-config/: (no justification provided) (duration: 587m 34s) [production]
10:50 <marostegui@cumin1001> dbctl commit (dc=all): 'db1183 (re)pooling @ 4%: Pooling T334080', diff saved to https://phabricator.wikimedia.org/P46222 and previous config saved to /var/cache/conftool/dbconfig/20230410-105043-root.json [production]
10:17 <marostegui@cumin1001> dbctl commit (dc=all): 'db1109 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46217 and previous config saved to /var/cache/conftool/dbconfig/20230410-101704-root.json [production]
08:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1161 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P46199 and previous config saved to /var/cache/conftool/dbconfig/20230410-082501-root.json [production]
07:20 <marostegui@cumin1001> dbctl commit (dc=all): 'db1220 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46183 and previous config saved to /var/cache/conftool/dbconfig/20230410-072048-root.json [production]
06:30 <marostegui@cumin1001> dbctl commit (dc=all): 'db1207 (re)pooling @ 4%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46167 and previous config saved to /var/cache/conftool/dbconfig/20230410-063046-root.json [production]
2023-04-06 §
08:09 <hashar@deploy2002> rebuilt and synchronized wikiversions files: all wikis to 1.41.0-wmf.3 refs T330209 [production]
2023-04-05 §
11:52 <marostegui@cumin1001> dbctl commit (dc=all): 'db1100 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P46063 and previous config saved to /var/cache/conftool/dbconfig/20230405-115249-root.json [production]
11:32 <marostegui@cumin1001> dbctl commit (dc=all): 'db1107 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P46059 and previous config saved to /var/cache/conftool/dbconfig/20230405-113246-root.json [production]
08:58 <hashar@deploy2002> Synchronized php: group1 wikis to 1.41.0-wmf.3 refs T330209 (duration: 05m 46s) [production]
08:52 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.3 refs T330209 [production]
08:25 <hashar@deploy2002> Synchronized wmf-config/InitialiseSettings.php: Remove akwiki from CX config (take 2, it was not fully deployed due to a scap lock issue on the spare server) (duration: 06m 06s) [production]
2023-04-04 §
19:10 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.3 refs T330209 [production]
09:51 <hashar@deploy2002> rebuilt and synchronized wikiversions files: Revert "group0 wikis to 1.41.0-wmf.3" | T330209 [production]
09:42 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.3 refs T330209 [production]
09:19 <hashar@deploy2002> Pruned MediaWiki: 1.41.0-wmf.1 (duration: 02m 16s) [production]
09:12 <hashar@deploy2002> Finished scap: testwikis wikis to 1.41.0-wmf.3 refs T330209 (duration: 40m 20s) [production]
08:32 <hashar@deploy2002> Started scap: testwikis wikis to 1.41.0-wmf.3 refs T330209 [production]
08:28 <hashar> Deleting mediawiki/core branch `wmf/branch_cut_pretest` pointing at `430d25d1a1858edfa4a6199dfe1f0eb3743a219a` # T330209 [production]
2023-04-03 §
21:52 <ryankemper> T331896 `sudo -E cumin -b 4 'wdqs*' 'sudo run-puppet-agent'` [production]
2023-03-31 §
08:38 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on an-worker1091.eqiad.wmnet with reason: Replacing battery [production]
08:38 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on an-worker1091.eqiad.wmnet with reason: Replacing battery [production]
2023-03-30 §
18:33 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: all wikis to 1.41.0-wmf.2 refs T330208 [production]