9451-9500 of 10000 results (67ms)
2022-01-30 §
14:41 <taavi> created a neutron port with ip 172.16.2.46 for a service ip for toolforge redis automatic failover T278541 [tools]
14:22 <taavi> creating a cluster of 3 bullseye redis hosts for T278541 [tools]
12:35 <wm-bot> <lucaswerkmeister> deployed c1d6a79ed2 (update Odia nongendered adjectives) [tools.lexeme-forms]
2022-01-29 §
23:42 <taavi> deploying https://gerrit.wikimedia.org/r/c/analytics/quarry/web/+/749756/ [quarry]
21:08 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudservices2003-dev.wikimedia.org with OS bullseye [production]
18:24 <taavi> delete 2 puppet prefixes in a weird state T299750 [admin]
18:04 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudservices2003-dev.wikimedia.org with OS bullseye [production]
17:57 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol2004-dev.wikimedia.org with OS bullseye [production]
16:56 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol2004-dev.wikimedia.org with OS bullseye [production]
13:53 <hashar> contint1001 and contint2001 : pruning old reflog from Zuul merger git repositories: `sudo -u zuul find /srv/zuul/git -maxdepth 4 -type d -name .git -print -execdir git reflog expire --all --expire=now \;` [production]
05:25 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcontrol2003-dev.wikimedia.org with OS bullseye [production]
04:45 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcontrol2003-dev.wikimedia.org with OS bullseye [production]
00:14 <ebernhardson> restart elasticsearch_6@production-search-psi-eqiad on elastic1049 to address CirrusSearchJVMGCOldPoolFlatlined alert [production]
2022-01-28 §
21:52 <mutante> purging font packages from mwdebug* and scandium* T294378 [production]
21:47 <mutante> purging font packages from remaining appservers in codfw mw23* ranges.. T294378 [production]
21:45 <taavi> running recountCategories.php on all beta wikis per T299823#7652496 [releng]
20:44 <wm-bot> <jeanfred> Deploy 13ed7a3 [tools.integraality]
20:14 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.postgresql.postgres-init (exit_code=99) [production]
20:10 <hnowlan@cumin1001> START - Cookbook sre.postgresql.postgres-init [production]
20:10 <hnowlan@cumin1001> END (PASS) - Cookbook sre.postgresql.postgres-init (exit_code=0) [production]
17:52 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1024.eqiad.wmnet with OS buster [production]
17:17 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase1023.eqiad.wmnet [production]
17:17 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase1024.eqiad.wmnet with OS buster [production]
17:14 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1023.eqiad.wmnet with OS buster [production]
16:41 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase1023.eqiad.wmnet with OS buster [production]
16:41 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase1022.eqiad.wmnet [production]
16:28 <wm-bot> trying to join node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud to the grid cluster in toolsbeta. - cookbook ran by arturo@nostromo [toolsbeta]
16:22 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1022.eqiad.wmnet with OS buster [production]
15:50 <hnowlan@cumin1001> START - Cookbook sre.postgresql.postgres-init [production]
15:50 <hnowlan@cumin1001> END (PASS) - Cookbook sre.postgresql.postgres-init (exit_code=0) [production]
15:47 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase1022.eqiad.wmnet with OS buster [production]
15:47 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase1021.eqiad.wmnet [production]
15:47 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1021.eqiad.wmnet with OS buster [production]
15:41 <vgutierrez> pool cp4031 using envoy as TLS termination layer - T271421 [production]
15:14 <Amir1> start of cleaning lint errors caused by content model changes (T298343) [production]
14:50 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase1021.eqiad.wmnet with OS buster [production]
14:50 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase1020.eqiad.wmnet [production]
14:47 <vgutierrez> update varnish to version 6.0.10-1wm1 on cp4036 - T300264 [production]
14:47 <Amir1> optimizing dewiki.flaggedtemplates in db2113 [production]
14:27 <hashar> taking heapdump of CI Jenkins `sudo -u jenkins /usr/lib/jvm/java-11-openjdk-amd64/bin/jmap -dump:live,format=b,file=/var/lib/jenkins/202201281527.hprof xxxx` [releng]
14:27 <vgutierrez> update varnish to version 6.0.10-1wm1 on cp4034 - T300264 [production]
14:07 <taavi> deploying https://gerrit.wikimedia.org/r/c/labs/tools/wikibugs2/+/757403 [tools.wikibugs]
14:07 <wikibugs> Updated channels.yaml to: 4c7bf9f3c273443eba9989f32dd1f563d3378e94 quibble messages only go to dedicated channel [tools.wikibugs]
13:20 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1020.eqiad.wmnet with OS buster [production]
13:01 <moritzm> installing uriparser security updates [production]
12:32 <marostegui@cumin1001> dbctl commit (dc=all): 'db1168 (re)pooling @ 100%: repooling after reimage', diff saved to https://phabricator.wikimedia.org/P19562 and previous config saved to /var/cache/conftool/dbconfig/20220128-123210-root.json [production]
12:30 <moritzm> installing libseccomp bugfix updates from bullseye point release [production]
12:28 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase1020.eqiad.wmnet with OS buster [production]
12:20 <vgutierrez> upload varnish 6.0.10-1wm1 to apt.wm.o (buster component/varnish6) - T300264 [production]
12:17 <marostegui@cumin1001> dbctl commit (dc=all): 'db1168 (re)pooling @ 75%: repooling after reimage', diff saved to https://phabricator.wikimedia.org/P19561 and previous config saved to /var/cache/conftool/dbconfig/20220128-121706-root.json [production]