7751-7800 of 10000 results (85ms)
2019-12-25 §
10:12 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:11 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
2019-12-24 §
15:33 <gehel@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
15:13 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:13 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:38 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:38 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:13 <gehel> data reload from wdqs1008 to wdqs1006 - T241418 [production]
14:11 <gehel@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
13:58 <jynus> tune2fs -m 0 /dev/mapper/wdqs1006--vg-data T241418 [production]
12:21 <volans@deploy1001> Finished deploy [debmonitor/deploy@39ad186]: Release v0.2.2 - T241206 (duration: 00m 40s) [production]
12:20 <volans@deploy1001> Started deploy [debmonitor/deploy@39ad186]: Release v0.2.2 - T241206 [production]
11:43 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: use TiffInfo again T240455 (duration: 01m 07s) [production]
02:45 <volker-e@deploy1001> Finished deploy [design/style-guide@8b2eda6]: Deploy design/style-guide: (duration: 00m 07s) [production]
02:45 <volker-e@deploy1001> Started deploy [design/style-guide@8b2eda6]: Deploy design/style-guide: [production]
00:13 <volker-e@deploy1001> Finished deploy [design/style-guide@efc240b]: Deploy design/style-guide: (duration: 00m 07s) [production]
00:13 <volker-e@deploy1001> Started deploy [design/style-guide@efc240b]: Deploy design/style-guide: [production]
2019-12-23 §
18:54 <chaomodus> Deleting mgmt IP addresses from Netbox that are connected to offline devices. T228387 [production]
15:57 <papaul> shut down ms-fe2007 for NIC replacement [production]
15:10 <fdans@deploy1001> Finished deploy [analytics/refinery@531752b]: deploying refinery (duration: 08m 09s) [production]
15:02 <fdans@deploy1001> Started deploy [analytics/refinery@531752b]: deploying refinery [production]
15:00 <jynus@cumin1001> dbctl commit (dc=all): 'Reducing db1126 main s8 weight, seems flapping', diff saved to https://phabricator.wikimedia.org/P10012 and previous config saved to /var/cache/conftool/dbconfig/20191223-150052-jynus.json [production]
13:42 <moritzm> installing cpio security updates on jessie [production]
13:31 <moritzm> installing NSS security updates on jessie [production]
13:23 <moritzm> installing libvorbis security updates [production]
13:01 <moritzm> uploaded libvpx 1.7.0-3+wmf2 to component/vp9 [production]
11:06 <jmm@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
11:05 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
11:05 <arturo> import python-pyasn1 0.4.2-3~bpo9+1~wmf1 into stretch-wikimedia/component/python-ldap-bpo (T229227) [production]
11:04 <moritzm> removing dubnium in ganeti T224557 [production]
10:47 <arturo> import python-ldap 3.1.0-2~bpo9+1~wmf1 into stretch-wikimedia/component/python-ldap-bpo (T229227) [production]
10:06 <moritzm> removing elastic1019 from puppetdb T239821 [production]
09:17 <_joe_> running docker-report for base images, as a test, on boron [production]
09:11 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2023.codfw.wmnet,service=ats-be [production]
09:10 <ema> cp2023: wipe ats-be cache and repool after normalize-path.lua experiment T241232 [production]
08:58 <moritzm> restarting slapd on serpens/seaborgium to pick up SASL security update [production]
08:50 <moritzm> restarting slapd on LDAP replicas to pick up SASL security update [production]
08:31 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2023.codfw.wmnet,service=ats-be [production]
08:31 <ema> cp2023: depool ats-be for Lua path normalization experiment T241232 [production]
08:17 <moritzm> installing cyrus-sasl2 security updates [production]
2019-12-22 §
16:48 <bd808> Mastodon feed moved to https://mastodon.social/@wikimedia_sal (T52109) [production]
16:44 <bd808> Trying another Mastodon account. Hopefully running at bot at @wikimedia_sal@mastodon.social is acceptable use for that server. [production]
05:58 <volker-e@deploy1001> Finished deploy [design/style-guide@9aa0b3d]: Deploy design/style-guide: (duration: 00m 07s) [production]
05:58 <volker-e@deploy1001> Started deploy [design/style-guide@9aa0b3d]: Deploy design/style-guide: [production]
00:10 <bd808> Wikimedia SAL messages now available on Mastodon! https://fosstodon.org/@wikimedia_sal [production]
2019-12-21 §
23:40 <bd808> Testing Mastodon logging of SAL messages (T52109) [production]
23:12 <volans> powercycle cp3055 - T240425 [production]
22:45 <volans> powercycle cp3051 - T241306 [production]
13:39 <Amir1> ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=testwikidatawiki --sleep 2 --batch-size=50 (T241209) [production]
04:01 <mutante> LDAP - added ifried to wmf (T240988) for Turnilo / Superset access [production]