4051-4100 of 10000 results (66ms)
2020-02-17 §
10:08 <arturo> restart webservice, because I see in the logs `uWSGI listen queue of socket ":8000" (fd: 7) full !!! (101/100)` [tools.copyvios]
10:00 <moritzm> installing Linux 4.9.210 kernels on stretch systems [production]
09:10 <godog> correction, +100G [production]
09:09 <godog> +10G to prometheus/ops fs on prometheus eqiad - T245361 [production]
09:06 <godog> +50G to prometheus/ops fs on prometheus eqiad - T245361 [production]
07:22 <marostegui> Stop haproxy on dbproxy1002 - T245384 [production]
2020-02-16 §
21:24 <hauskatze> AbuseFilterBypass@github: Deleted 'dev' branch | T245363 [releng]
21:24 <hauskatze> AbuseFilterBypass@github: Switch default branch of mirror to 'master' | T245363 [releng]
16:49 <JeanFred> "Deploy latest from Git master: 0fcb522 (T243780), 4cb6a5a (T243780, T239067)" [tools.integraality]
14:56 <lucaswerkmeister> deployed 5e1e3d97ac (follow redirects by default, !title to edit the redirect itself) [tools.quickcategories]
2020-02-15 §
23:52 <legoktm> rebuilding tox docker image for https://gerrit.wikimedia.org/r/572453 [releng]
22:21 <legoktm> reloading zuul for https://gerrit.wikimedia.org/r/572423 [releng]
21:33 <hauskatze> GitHub: Activated Travis CI at https://travis-ci.org/wikimedia/texvcjs for https://github.com/wikimedia/texvcjs per https://github.com/wikimedia/texvcjs/pull/34 and T245344 [releng]
20:25 <Krenair> T243226 Shut off deployment-puppetdb02 and deployment-puppetmaster03 - will leave for a week before deletion [releng]
20:13 <bd808> Setup ingress objects [tools.iw]
18:52 <bd808> Edited ingress/bash-legacy to redirect unconditionally to https://bash.toolforge.org and switched OAuth creds to matching grant [tools.bash]
15:46 <andrewbogott> deleting project and remaining instance as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge [design]
15:43 <andrewbogott> deleting traffic-cache-atsupload as per ema's comment in #wikimedia-sre [traffic]
12:07 <elukey> re-run failed pageview druid hour [analytics]
12:05 <elukey> re-run failed virtualpageview hours [analytics]
01:01 <cdanis> ✔️ cdanis@an-coord1001.eqiad.wmnet ~ 🕗🍺 sudo systemctl restart hive-server2.service ; sudo systemctl restart hive-metastore.service [production]
2020-02-14 §
23:42 <XenoRyet> updated civicrm from cf86495d44 to 8c77e9e915 [production]
22:02 <Krenair> Restarting webservice as everything was waiting and then returning 504 etc [tools.openstack-browser]
21:53 <andrewbogott> moving deployment-puppetdb02 and deployment-puppetmaster03 off of cloudvirt1014 (which will be drained next week anyway) [releng]
21:53 <andrewbogott> moving deployment-puppetdb02 and deployment-puppetmaster03 off of cloudvirt1014 (which will be drained next week anyway) [deployment-prep]
21:31 <andrewbogott> restarting paws-puppetmaster-01 so its clients can connect [paws]
21:01 <volker-e@deploy1001> Finished deploy [design/style-guide@1928c00]: Deploy design/style-guide: (duration: 00m 09s) [production]
21:01 <volker-e@deploy1001> Started deploy [design/style-guide@1928c00]: Deploy design/style-guide: [production]
20:33 <brennen> Updating dev-images docker-pkg files on contint1001 to attempt a rebuild for https://gerrit.wikimedia.org/r/c/releng/dev-images/+/571828 [releng]
20:21 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: Prevent some logspam T245280 (duration: 01m 05s) [production]
20:18 <andrewbogott> adding profile::rsyslog::kafka_shipper::kafka_brokers: [] to project-wide puppet setting [ores]
20:16 <andrewbogott> adding profile::ores::logstash_host: localhost to project-wide puppet config [ores]
20:09 <andrewbogott> added profile::prometheus::statsd_exporter::mappings: [] setting to the thanks-be prefix to fix puppet runs [monitoring]
20:05 <thcipriani> deployment-mwmaint01:rm lingering .~tmp~ directories from failed rsync's taking up space [releng]
19:31 <thcipriani> deployment-snapshot01:sudo apt-get clean cleared 1.2G of space [releng]
19:27 <XenoRyet> updated civicrm from 55b2afb6eb to cf86495d44 [production]
19:09 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.19/extensions/Wikibase: T245062 Prevent invalid term languages from cached PrefetchingTermLookup (duration: 01m 09s) [production]
17:37 <jforrester@deploy1001> Unlocked for deployment [ALL REPOSITORIES]: Testing T245062 fix on mwdebug1001 (duration: 03m 05s) [production]
17:34 <thcipriani> reloading zuul to deploy https://gerrit.wikimedia.org/r/571849 [releng]
17:33 <jforrester@deploy1001> Locking from deployment [ALL REPOSITORIES]: Testing T245062 fix on mwdebug1001 (planned duration: 60m 00s) [production]
17:23 <thcipriani> Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/571849 [releng]
17:20 <thcipriani> updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/571849 [releng]
16:11 <moritzm> installing git-lfs updates from Buster 10.3 point update [production]
15:55 <moritzm> uploaded pypuppetdb 0.3.3-2~wmf+deb10u1 to apt.wikimedia.org [production]
15:55 <bblack> (log(n)) [production]
15:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2086:3318 T239453', diff saved to https://phabricator.wikimedia.org/P10414 and previous config saved to /var/cache/conftool/dbconfig/20200214-155443-marostegui.json [production]
15:52 <moritzm> uploaded pypuppetdb 0.3.3-2~wmf+deb9u1 to apt.wikimedia.org [production]
15:46 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Resync initialisesetting to try and pick up previoiusly deployed cirrus query routing changes (duration: 01m 05s) [production]
15:42 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:42 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]