651-700 of 10000 results (33ms)
2021-06-15 §
09:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2080', diff saved to https://phabricator.wikimedia.org/P16533 and previous config saved to /var/cache/conftool/dbconfig/20210615-092511-marostegui.json [production]
09:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2086:3318, db2082', diff saved to https://phabricator.wikimedia.org/P16532 and previous config saved to /var/cache/conftool/dbconfig/20210615-092409-marostegui.json [production]
09:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2086:3318', diff saved to https://phabricator.wikimedia.org/P16531 and previous config saved to /var/cache/conftool/dbconfig/20210615-090802-marostegui.json [production]
09:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db2083', diff saved to https://phabricator.wikimedia.org/P16530 and previous config saved to /var/cache/conftool/dbconfig/20210615-090650-marostegui.json [production]
09:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db2084', diff saved to https://phabricator.wikimedia.org/P16529 and previous config saved to /var/cache/conftool/dbconfig/20210615-090243-marostegui.json [production]
09:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db2081', diff saved to https://phabricator.wikimedia.org/P16528 and previous config saved to /var/cache/conftool/dbconfig/20210615-090206-marostegui.json [production]
08:59 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2082', diff saved to https://phabricator.wikimedia.org/P16527 and previous config saved to /var/cache/conftool/dbconfig/20210615-085953-marostegui.json [production]
08:59 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2091', diff saved to https://phabricator.wikimedia.org/P16526 and previous config saved to /var/cache/conftool/dbconfig/20210615-085938-marostegui.json [production]
08:32 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2080 db2083 db2084 db2091', diff saved to https://phabricator.wikimedia.org/P16525 and previous config saved to /var/cache/conftool/dbconfig/20210615-083233-marostegui.json [production]
08:28 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2081', diff saved to https://phabricator.wikimedia.org/P16524 and previous config saved to /var/cache/conftool/dbconfig/20210615-082857-marostegui.json [production]
06:10 <XioNoX> roll OSPF link-protection to all routers - T167306 [production]
02:30 <eileen> civicrm revision changed from d9d61dad0b to acbcce94a2, config revision is 2aed6ff89b [production]
01:22 <eileen> civicrm revision changed from 28ace1b86f to d9d61dad0b, config revision is 2aed6ff89b [production]
01:18 <bstorm> running a modified version of the prometheus dir size cron in screen T284964 [admin]
00:40 <bstorm> truncated 4GB uwsgi.log to free space T284968 [tools.eatchabot]
00:37 <eileen> civicrm revision changed from 31d07115a0 to 28ace1b86f, config revision is 2aed6ff89b [production]
2021-06-14 §
23:58 <wm-bot> <lucaswerkmeister> deployed 626b73a005 (l10n updates) [tools.lexeme-forms]
23:56 <wm-bot> <lucaswerkmeister> deployed 70efbdc1a7 (update volitive item ID) [tools.lexeme-forms]
22:21 <bstorm> push docker-registry.tools.wmflabs.org/toolforge-python37-sssd-web:testing to test staged os.execv (and other patches) using toolsbeta toollabs-webservice version 0.75 T282975 [tools]
22:06 <brennen> gitlab-test: repointing floating IP to ansible test box, running ansible to test issue & wiki default config [releng]
21:41 <brennen> gitlab-test: repointing floating IP to main test instance; gitlab-ctl reconfigure to test some feature flags [releng]
21:40 <ebernhardson@deploy1002> Finished deploy [search/mjolnir/deploy@baeee47]: T261407 bulk_daemon: Deploy prioritized topics (duration: 00m 49s) [production]
21:40 <ebernhardson@deploy1002> Started deploy [search/mjolnir/deploy@baeee47]: T261407 bulk_daemon: Deploy prioritized topics [production]
21:37 <Krinkle> Update /srv/cvn/git/stillalive check out on all cvn-* servers to fetch from remote `main` instead of `master` [cvn]
21:29 <MacFan4000> copied freenode config for #cvn-sw to libera [wm-bot]
21:29 <bstorm> deploy package with the staged patch to switch away from os.execv to QA in toolsbeta as toollabs-webservice version 0.75 T282975 [toolsbeta]
19:37 <majavah> add self as maintainer T284938 [tools.vpsalertmanager]
19:27 <razzi@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host an-airflow1003.eqiad.wmnet [production]
19:21 <twentyafterfour_> applying hotfix for T284397 and restarting php7.3-fpm on phab1001 [production]
18:45 <ottomata> remove packges from hadoop common nodes: sudo cumin 'R:Class = profile::analytics::cluster::packages::common' 'apt-get -y remove python3-pandas python3-pycountry python3-numpy python3-tz' - T275786 [analytics]
18:43 <ottomata> remove packges from stat nodes: sudo cumin 'stat*' apt-get -y remove subversion mercurial tofrodos libwww-perl libcgi-pm-perl libjson-perl libtext-csv-xs-perl libproj-dev libboost-regex-dev libboost-system-dev libgoogle-glog-dev libboost-iostreams-dev libgdal-dev [analytics]
18:40 <balloons> Add majavah as projectadmin T284938 [metricsinfra]
18:30 <razzi@cumin1001> START - Cookbook sre.ganeti.makevm for new host an-airflow1003.eqiad.wmnet [production]
17:05 <jforrester@deploy1002> Finished deploy [integration/docroot@22061b6]: Actually add mediawiki/tools/api-testing JSDoc to doc.wikimedia for T236915 (duration: 00m 07s) [production]
17:05 <jforrester@deploy1002> Started deploy [integration/docroot@22061b6]: Actually add mediawiki/tools/api-testing JSDoc to doc.wikimedia for T236915 [production]
16:57 <James_F> uul: [mediawiki/tools/api-testing] Publish docs on postmerge T236915 [releng]
16:46 <jforrester@deploy1002> Finished deploy [integration/docroot@ca7af97]: Add mediawiki/tools/api-testing JSDoc to doc.wikimedia for T236915 (duration: 00m 07s) [production]
16:46 <jforrester@deploy1002> Started deploy [integration/docroot@ca7af97]: Add mediawiki/tools/api-testing JSDoc to doc.wikimedia for T236915 [production]
16:31 <James_F> Zuul: [mediawiki/tools/api-testing] Add npm run doc and publishing T236915 [releng]
16:28 <James_F> Zuul: Add Yashvarshney02 to Trusted users [releng]
16:25 <James_F> Zuul: Add Jay (CIS-A2K) to Trusted users [releng]
16:22 <James_F> Zuul: Add initial CI for cloud/toolforge/jobs-framework-cli [releng]
15:56 <razzi@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host an-airflow1002.eqiad.wmnet [production]
15:52 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 100%: Repool db1142 after upgrade', diff saved to https://phabricator.wikimedia.org/P16521 and previous config saved to /var/cache/conftool/dbconfig/20210614-155258-root.json [production]
15:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 75%: Repool db1142 after upgrade', diff saved to https://phabricator.wikimedia.org/P16520 and previous config saved to /var/cache/conftool/dbconfig/20210614-153754-root.json [production]
15:24 <otto@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) [production]
15:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 50%: Repool db1142 after upgrade', diff saved to https://phabricator.wikimedia.org/P16519 and previous config saved to /var/cache/conftool/dbconfig/20210614-152250-root.json [production]
15:13 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host maps1005.eqiad.wmnet [production]
15:07 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 25%: Repool db1142 after upgrade', diff saved to https://phabricator.wikimedia.org/P16518 and previous config saved to /var/cache/conftool/dbconfig/20210614-150747-root.json [production]
15:07 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host maps1005.eqiad.wmnet [production]