5401-5450 of 10000 results (59ms)
2017-11-20 §
14:22 <jynus> enable semi-sync replication on s5 [production]
14:14 <dcausse@tin> Synchronized wmf-config/CirrusSearch-common.php: T180805: Revert [cirrus] disable token count router (duration: 00m 49s) [production]
14:05 <elukey> upload prometheus-druid-exporter 0.3 to jessie-wikimedia [production]
13:53 <Pchelolo> disable puppet on scb100x and stop cpjobqueue to accumulate some backlog [production]
13:39 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@174420f]: Optimise committed offset calculation (duration: 00m 28s) [production]
13:39 <ppchelko@tin> Started deploy [cpjobqueue/deploy@174420f]: Optimise committed offset calculation [production]
13:30 <elukey> upload prometheus-druid-exporter 0.3 to stretch-wikimedia [production]
12:40 <marostegui> Optimize db1063 wikidatawiki.wb_terms [production]
12:17 <moritzm> uploaded hhvm 3.18.5+dfsg-1+wmf1+icu57 to apt.wikimedia.org (jessie-wikimedia/component/icu57) (HHVM build linked against a co-installable backport of icu57) [production]
11:46 <moritzm> rebooting tungsten for update to 4.9.51 [production]
11:41 <moritzm> rebooting etherpad1001 (etherpad.wikimedia.org) for update to 4.9.51 [production]
11:36 <moritzm> rebooting pybal-test for update to 4.9.51 [production]
11:27 <moritzm> rebooting restbase-test cluster for update to 4.9.51 [production]
11:23 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@bdcef23]: Various performance improvements in committing (duration: 00m 30s) [production]
11:22 <ppchelko@tin> Started deploy [cpjobqueue/deploy@bdcef23]: Various performance improvements in committing [production]
11:13 <moritzm> rebooting ruthenium for update to 4.9.51 [production]
10:57 <godog> reimage restbase2004 - T179422 [production]
10:51 <moritzm> rebooting cerium/praseodymium/xenon for update to 4.9.51 [production]
10:42 <moritzm> rebooting mwlog1001 for update to 4.9.51 [production]
10:39 <moritzm> rebooting mwlog2001 for update to 4.9.51 [production]
10:23 <hoo> Manually re-started the Wikidata entity JSON dump on snapshot1007 (T180934) [production]
10:19 <dcausse> elastic/cirrus: reindexing english group0 and group1 wikis: T179945 [production]
10:08 <hashar> contint1001: sudo systemctl start jenkins [production]
10:05 <moritzm> rebooting contint1001 for update to 4.9.51 [production]
09:22 <moritzm> rebooting hafnium for update to 4.9.51 [production]
08:46 <marostegui> Run mydumper for db1047.staging - T156844 [production]
07:58 <moritzm> installing procmail security updates [production]
07:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1097 - T178359 (duration: 00m 49s) [production]
06:41 <marostegui> Stop MySQL on db1082 to clone db1109 and db1110 - T180700 [production]
06:36 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1082 - T177208 (duration: 00m 48s) [production]
06:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore original weights for db1100 and db1071 - T180917 (duration: 00m 49s) [production]
06:15 <marostegui> Reboot db2068 - T180927 [production]
02:28 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.7) (duration: 06m 26s) [production]
2017-11-19 §
23:20 <Jamesofur> removed 2FA for Ask21 T180889 [production]
20:28 <krinkle@tin> Synchronized docroot/noc/index.html: noc: Link to Grafana (duration: 00m 49s) [production]
19:50 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1100 (duration: 00m 49s) [production]
07:09 <mobrovac@tin> Started restart [zotero/translators@a0c41c3]: Zotero eating up memory [production]
07:01 <mobrovac@tin> Started restart [electron-render/deploy@8dd5f13]: electron stuck - T174916 [production]
2017-11-18 §
20:06 <gehel> upgrade of elasticsearch eqiad complete - T178411 [production]
18:03 <reedy@tin> Synchronized multiversion/vendor/: bump (duration: 01m 14s) [production]
15:53 <marostegui> Compress s5 on db2085 - T178359 [production]
14:48 <marostegui> Compress s3 on db2092 - T178359 [production]
00:30 <urandom> Bootstrapping restbase2006-b (T179422) [production]
2017-11-17 §
20:35 <mutante> netmon1002 - rsync smokeping data back from local backup to show measurements made from eqiad as requested on T180812 [production]
20:05 <mutante> running puppet on all cache misc to switch smokeping web to eqiad [production]
20:02 <mutante> T180812 copying smokeping data from 2001 to 1002 - netmon1002: /usr/bin/rsync -avp rsync://netmon2001.wikimedia.org/var-lib-smokeping /var/lib/smokeping/ | switching backend from codfw to eqiad [production]
19:37 <mutante> T180812 - @netmon1002:# rsync -avp /var/lib/smokeping/ /root/backup/netmon1002/201711717/var/lib/smokeping/@netmon2001:/# rsync -avp /var/lib/smokeping/ /root/backup/netmon2001/201711717/var/lib/smokeping/ [production]
19:36 <mutante> @netmon1002:/var/lib/smokeping# rsync -avp /var/lib/smokeping/ /root/backup/netmon1002/201711717/var/lib/smokeping/ [production]
18:37 <anomie@tin> Synchronized wmf-config/InitialiseSettings.php: Setting wgCommentTableSchemaMigrationStage = MIGRATION_WRITE_BOTH on Beta Cluster, no prod change (duration: 00m 48s) [production]
18:36 <anomie@tin> Synchronized wmf-config/InitialiseSettings-labs.php: Setting wgCommentTableSchemaMigrationStage = MIGRATION_WRITE_BOTH on Beta Cluster, no prod change (duration: 00m 49s) [production]