6051-6100 of 10000 results (77ms)
2019-12-16 §
06:29 <marostegui> Remove triggers for ar_comment on db1125:3314 T234704 [production]
06:28 <marostegui> Stop replication on db1121 for schema change [production]
06:28 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1121 for schema change', diff saved to https://phabricator.wikimedia.org/P9871 and previous config saved to /var/cache/conftool/dbconfig/20191216-062809-marostegui.json [production]
03:52 <tstarling@deploy1001> Synchronized docroot/mediawiki.org/keys/keys.html: (no justification provided) (duration: 00m 57s) [production]
03:49 <tstarling@deploy1001> Synchronized docroot/mediawiki.org/keys/keys.txt: (no justification provided) (duration: 01m 01s) [production]
2019-12-14 §
22:50 <hashar> Restarted Gerrit on gerrit2001 # T240763 [production]
2019-12-13 §
22:35 <cdanis> T229686 ✔️ cdanis@mwdebug1001.eqiad.wmnet /srv/mediawiki 🕠🍺 scap pull [production]
21:58 <cdanis> testing I0e0de86d by hand on mwdebug1001 T229686 [production]
21:57 <cdanis> testing I0e0de86d by hand on mwdebug1001 [production]
21:50 <otto@deploy1001> Finished deploy [analytics/hdfs-tools/deploy@06e5f42]: (no justification provided) (duration: 00m 03s) [production]
21:50 <otto@deploy1001> Started deploy [analytics/hdfs-tools/deploy@06e5f42]: (no justification provided) [production]
21:31 <onimisionipe> depool maps2004 for osm initial import - T239728 [production]
21:29 <otto@deploy1001> Finished deploy [hdfs-tools-deploy@c71e63a]: (no justification provided) (duration: 00m 08s) [production]
21:29 <onimisionipe> disabled tilerator on maps200[1-3] - T239728 [production]
21:29 <otto@deploy1001> Started deploy [hdfs-tools-deploy@c71e63a]: (no justification provided) [production]
20:31 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
20:29 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
20:26 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
20:07 <sbassett> Deployed security patch (via gerrit 557097) for T240487 to wmf.10 [production]
19:33 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Fix typo in 'wgMachineVisionShowUploadWizardCallToAction' (duration: 01m 00s) [production]
14:51 <onimisionipe> depool maps1003 after postgres init - T239728 [production]
14:37 <onimisionipe> pool maps1002 after postgres init - T239728 [production]
11:46 <moritzm> installing tiff security updates [production]
10:52 <moritzm> rebooting mw2164 for microcode tests [production]
10:52 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:52 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
10:30 <moritzm> uploaded doxygen 1.8.16-1~exp4~deb10+wmf1 to buster-wikimedia/component/ci T239482 [production]
10:17 <ema> cp4028: restart ats-be to enable xdebug plugin [production]
09:55 <_joe_> restarting pybal on lvs in esams (3007, then 3006 and 3005) [production]
09:50 <rlazarus> rzl@conf1006:~$ sudo systemctl restart etcd.service [production]
08:48 <andrewbogott> rebooting cloudvirt1023 to investigate some nova things [production]
08:10 <elukey> rm /var/log user.log.1 messages.1 daemon.log.1 kafkatee.log.1 syslog.1 on netflow2001 to free space (logs spammed with the same error message over and over) [production]
08:07 <elukey> restart kafkatee-webrequest.service on netflow1001 (spamming logs about not being able to bind to address:port) [production]
08:07 <elukey> restart fastmon on netflow2001 as attempt to stop spamming logs (failed) [production]
08:06 <elukey> restart kafkatee-webrequest.service on netflow2001 (spamming logs about not being able to bind to address:port) [production]
07:56 <onimisionipe> depool maps1002 for postgres init. - T239728 [production]
07:55 <elukey> execute clear bfd session address fe80::ee38:7300:17e8:a04e on cr3-knams to restore BFD session with eqdfw (OSPF3 status ok on cr3-knams) [production]
06:30 <moritzm> installing libice security updates [production]
00:32 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: GrowthExperiments: Begin "initiation test" for suggested edits (T238888) (duration: 00m 55s) [production]
00:21 <catrope@deploy1001> Synchronized php-1.35.0-wmf.10/extensions/GrowthExperiments/: GrowthExperiments: record suggestededits pre-activation as a preference (T238888) (duration: 00m 55s) [production]
00:10 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: GrowthExperiments: Align help panel new account enabling with homepage (T232396) (duration: 00m 56s) [production]
2019-12-12 §
22:48 <eileen> process-control config revision is d195531033 jobs temporarily disabled [production]
22:33 <eileen> civicrm revision changed from 2043c27a0e to ad2303ef72, config revision is 4d25b656e2 [production]
21:31 <arlolra@deploy1001> Finished deploy [parsoid/deploy@75d72e8]: Updating Parsoid to 28d7c21 (duration: 07m 41s) [production]
21:23 <arlolra@deploy1001> Started deploy [parsoid/deploy@75d72e8]: Updating Parsoid to 28d7c21 [production]
20:54 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Drop wgMediaInfoEnableOtherStatements, wgDepictsQualifierProperties, and wgDisableRollbackConfirmationFeature (duration: 00m 58s) [production]
20:52 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Drop wgSpamBlacklistEventLogging, no longer read (duration: 00m 58s) [production]
20:48 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T240546 Enable the Wikisource extension on all Wikisources except old Wikisource (duration: 00m 57s) [production]
20:46 <jforrester@deploy1001> Synchronized static/images/project-logos/wikimaniawiki.png: T240578 Change wikimaniawiki logo back to general version, 1x (duration: 00m 56s) [production]
20:45 <jforrester@deploy1001> Synchronized static/images/project-logos/wikimaniawiki-1.5x.png: T240578 Change wikimaniawiki logo back to general version, 1.5x (duration: 00m 55s) [production]