51-100 of 10000 results (54ms)
2019-08-02 §
07:00 <_joe_> running systemd-tmpfiles --create nutcracker.conf on scandium [production]
06:46 <vgutierrez> upgrading acme-chief to version 0.20 in acme-chief test instances - T229096 [production]
05:21 <vgutierrez> uploaded acme-chief 0.20 to apt.wikimedia.org (buster) - T229096 [production]
05:10 <marostegui> Stop MySQL on db2058 for decommissioning T229543 [production]
05:06 <marostegui> Remove db2058 from tendril and zarcillo T229543 [production]
2019-08-01 §
23:32 <Urbanecm> Evening SWAT done [production]
23:32 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 819073a: Add `autopatrolled` group to az wikisource (T229371) (duration: 00m 49s) [production]
23:29 <urbanecm@deploy1001> Synchronized wmf-config/flaggedrevs.php: SWAT: 8aca0eb: Remove the "autoreview" user group from ru.wikipedia (T229596) (duration: 00m 47s) [production]
23:22 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: cf01272: Add importing to english wikiquote (T228607) (duration: 00m 48s) [production]
23:10 <ebernhardson@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: T229614: Pass proper types to eventlogging to resolve eventlogging errors in wmf.16 (duration: 00m 47s) [production]
22:52 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@5ebf93e]: Update mobileapps to 2ee48ab (duration: 04m 34s) [production]
22:47 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@5ebf93e]: Update mobileapps to 2ee48ab [production]
22:17 <ebernhardson@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/WikimediaEvents/extension.json: T229614: Update eventlogging schema version to resolve eventlogging errors in wmf.16 (duration: 00m 47s) [production]
22:13 <mutante> scandium apt-get autoremove [production]
22:13 <mutante> scandium apt-get remove --purge wikimedia-lvs-realserver (T228069) [production]
21:48 <mutante> scandium - apt-get remove --purge hhvm* (T228069) [production]
21:23 <brennen@deploy1001> Synchronized php: group1 and group2 to 1.34.0-wmf.16 (duration: 00m 46s) [production]
21:22 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 and group2 to 1.34.0-wmf.16 [production]
20:57 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.16/includes/Revision/RevisionRenderer.php: T229589 - 3f1b32e4db3698b8 (duration: 00m 50s) [production]
20:47 <mutante> scandium - turning into an mw appserver [production]
20:46 <mutante> puppetmaster: create mcrouter certs for scandium.eqiad.wmnet needed to make it an appserver (https://wikitech.wikimedia.org/wiki/Mcrouter#Generate_certs_for_a_new_host) (T228069) [production]
20:29 <bblack> restart pybal on lvs1014 [production]
19:57 <bblack> lvs1016 - restart pybal for slight LVS config change for cloudelastic - T224324 [production]
19:40 <brennen@deploy1001> Synchronized php: Revert group1 and group2 back to 1.34.0-wmf.15 (duration: 00m 53s) [production]
19:39 <twentyafterfour> finished phabricator database dump [production]
19:34 <bblack> lvs1014 - puppetize and restart pybal for cloudelastic LVS - T224324 [production]
19:31 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 and group2 to 1.34.0-wmf.15 [production]
19:20 <brennen> rolling back to wfm.15 on group1 and group2 while we investigate T229575 [production]
19:12 <brennen@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.16 [production]
18:52 <mutante> scandium (parsoid testing) - added mw application server roles - puppet work / maintenance [production]
18:47 <mutante> stat1004 - starting nagios-nrpe-server which got killed again - jbd2/md0-8 invoked oom-killer [production]
18:32 <bblack@puppetmaster1001> conftool action : set/pooled=yes; selector: name=^cloudelastic.* [production]
18:30 <bblack> lvs1016: puppet re-enabled, pybal restarted, cloudelastic deploy - T224324 [production]
18:06 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: 469c42d: Switch testwiki to read sessions from kask, with fallback to redis (T222099) (duration: 00m 55s) [production]
17:42 <bblack> disable puppet on lvs1014 + lvs1016 for cloudelastic LVS merge - T224324 [production]
17:36 <twentyafterfour> running db dump on phab1003 (in tmux). command: sudo ./bin/storage dump --output /srv/dumps/phabricator_db_20190801.sql.gz --compress [production]
16:05 <XioNoX> power down msw1-codfw [production]
15:47 <XioNoX> start codfw mgmt work - T228112 [production]
15:40 <brennen@deploy1001> Synchronized php: group1 wikis to 1.34.0-wmf.16 (duration: 00m 54s) [production]
15:39 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.16 [production]
15:16 <mholloway-shell@deploy1001> Synchronized php-1.34.0-wmf.15/extensions/Wikibase: Do not warn about entity that was not found in WikiPageEntityRevisionLookup (T229482) (duration: 01m 14s) [production]
15:13 <mholloway-shell@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/Wikibase: Do not warn about entity that was not found in WikiPageEntityRevisionLookup (T229482) (duration: 01m 20s) [production]
14:51 <herron> performing rolling restarts of eqiad logstash cluster for security updates [production]
14:38 <cdanis@deploy1001> Synchronized wmf-config/CommonSettings.php: Iaaa1238 comment-only no-op change (dbctl to 100% of production!) (duration: 00m 55s) [production]
14:22 <cdanis@deploy1001> Synchronized wmf-config/etcd.php: Iaaa1238 dbctl to 100% of production! (duration: 00m 54s) [production]
12:38 <jbond42> add cp1008 to canary hosts https://github.com/wikimedia/puppet/blob/production/hieradata/role/common/puppetmaster/frontend.yaml#L22 [production]
12:18 <marostegui> Rename math table on db1089 (enwiki) - T196055 [production]
11:42 <Urbanecm> EU SWAT done [production]
11:40 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: c51baa3: Add files.geocollections.info to the wgCopyUploadsDomains whitelist for commonswiki (T229547) (duration: 00m 55s) [production]
11:34 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 1e4458e: Add nlm.nih.gov to the wgCopyUploadsDomains whitelist for commonswiki (T229470) (duration: 00m 53s) [production]