151-200 of 10000 results (50ms)
2019-08-06 §
19:22 <thcipriani> gerrit restart on cobalt [production]
19:12 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Group0 to 1.34.0-wmf.17 [production]
18:38 <brennen@deploy1001> Finished scap: testwiki to php-1.34.0-wmf.17 and rebuild l10n cache (duration: 19m 02s) [production]
18:19 <brennen@deploy1001> Started scap: testwiki to php-1.34.0-wmf.17 and rebuild l10n cache [production]
18:13 <brennen@deploy1001> Pruned MediaWiki: 1.34.0-wmf.14 [keeping static files] (duration: 08m 28s) [production]
17:37 <accraze@deploy1001> Finished deploy [ores/deploy@d08fa62]: T229848 (duration: 17m 21s) [production]
17:20 <accraze@deploy1001> Started deploy [ores/deploy@d08fa62]: T229848 [production]
17:14 <volans> uploaded spicerack_0.0.26-1_amd64.deb to apt.wikimedia.org stretch-wikimedia [production]
16:54 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=mathoid,name=codfw [production]
16:52 <@> helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'production' . [production]
16:50 <brennen> cutting branch for 1.34.0-wmf.17 [production]
16:50 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=citoid,name=codfw [production]
16:50 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics,name=codfw [production]
16:48 <@> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
16:47 <akosiaris@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=mathoid,name=codfw [production]
16:43 <akosiaris@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=eventgate-analytics,name=codfw [production]
16:40 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T220625: Re-sync enable group1 on cloudelastic, job runners are claiming its not enabled while app servers are sending jobs (duration: 00m 47s) [production]
16:39 <@> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
16:37 <@> helmfile [CODFW] Ran 'apply' command on namespace 'blubberoid' for release 'production' . [production]
16:36 <@> helmfile [CODFW] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
16:33 <@> helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'production' . [production]
16:33 <@> helmfile [CODFW] Ran 'apply' command on namespace 'mathoid' for release 'production' . [production]
16:33 <@> helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'production' . [production]
16:32 <@> helmfile [CODFW] Ran 'apply' command on namespace 'mathoid' for release 'production' . [production]
16:31 <@> helmfile [STAGING] Ran 'apply' command on namespace 'mathoid' for release 'staging' . [production]
16:19 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T220625: Turn on cloudelastic writes for group1 (duration: 00m 47s) [production]
16:08 <akosiaris@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=citoid,name=codfw [production]
15:13 <moritzm> installing bind9 security updates (client-side tools/libs only) for jessie [production]
15:04 <cdanis> ✔️ cdanis@cumin1001.eqiad.wmnet ~ 🕚☕ sudo debdeploy deploy -u 2019-08-06-conftool.yaml -s all [production]
14:55 <moritzm> rebooting mwlog1001 for kernel update [production]
14:55 <cdanis> ✔️ cdanis@cumin1001.eqiad.wmnet ~ 🕚☕ sudo cumin -p99 -b100 'A:all' 'apt-get update' [production]
14:54 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:54 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:52 <herron> restarting logstash service on logstash1007 to pick up puppet managed log4j2 config [production]
14:50 <cdanis> ✔️ cdanis@cumin1001.eqiad.wmnet ~ 🕚☕ sudo debdeploy deploy -u 2019-08-06-conftool.yaml -s mw-canary [production]
14:45 <cdanis> ✔️ cdanis@install1002.wikimedia.org ~/conftool-1.1.4-2 🕥☕ sudo -E reprepro -C main include buster-wikimedia conftool_1.1.4-2+deb10u1_amd64.changes [production]
14:44 <cdanis> ✔️ cdanis@install1002.wikimedia.org ~/conftool-1.1.4-2 🕥☕ sudo -E reprepro -C main include stretch-wikimedia conftool_1.1.4-2_amd64.changes [production]
14:37 <cdanis> ✔️ cdanis@install1002.wikimedia.org ~/conftool-1.1.4-2 🕥 sudo -E reprepro -C main include jessie-wikimedia conftool_1.1.4-2+deb8u1_amd64.changes [production]
14:36 <marostegui> Start mysql on db1100 after on-site maintenance - T228732 [production]
12:30 <elukey> roll restart cassandra on aqs for openjdk-8 upgrades [production]
12:06 <akosiaris@> helmfile [CODFW] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
12:05 <akosiaris@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
11:49 <akosiaris@> helmfile [CODFW] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
11:49 <akosiaris@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
11:36 <Urbanecm> EU SWAT done [production]
11:21 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/AbuseFilter/: SWAT: 8cc96db: Better handling of DNONE (T214674, T228677) (duration: 00m 48s) [production]
11:11 <moritzm> rebooting install1002 to pick up MDS-enabled qemu [production]
11:11 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:11 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
11:08 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:528405|Disable EntitySchema in production wikidata ]] (duration: 00m 48s) [production]