4401-4450 of 10000 results (67ms)
2019-05-07 §
07:21 <mobrovac@deploy1001> Finished deploy [restbase/deploy@d91ee4c] (dev-cluster): Remove section functionality from the REST API (duration: 03m 02s) [production]
07:21 <marostegui> Optimize tables on pc1010 [production]
07:18 <mobrovac@deploy1001> Started deploy [restbase/deploy@d91ee4c] (dev-cluster): Remove section functionality from the REST API [production]
06:59 <moritzm> updating firmware-bnx2x (from stretch point release, this is a NOP, the source package firmware-nonfree was updated for various Wifi chipsets we don't use, doublechecked by comparing check sums for old and new bnx2x firmware) [production]
06:44 <elukey> restart uwsgi-netbox on netmon1002 after segfault [production]
05:23 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Promote db2045 to codfw x1 master T219493 (duration: 00m 55s) [production]
05:12 <marostegui> Change topology on x1 codfw to promote db2045 to master T219493 [production]
02:12 <tstarling@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Use Preprocessor_Hash unconditionally (duration: 00m 52s) [production]
00:53 <mutante> install2002 - disabling puppet, live hacking DHCP config for db2103 to not serve installer via http to debug install issue for T221532 which seems like T190424#4548003 [production]
00:38 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.3/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.ArticleTarget.js: Hot-deploy fix for visual diffs on mobile in non-section mode T222489 (duration: 00m 53s) [production]
00:32 <ejegg> disabled fundraising scheduled jobs for CiviCRM maintenance [production]
2019-05-06 §
23:25 <maxsem@deploy1001> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/503546/ (duration: 00m 50s) [production]
22:46 <crusnov@deploy1001> Finished deploy [netbox/deploy@0061190]: Deploy new version of ganeti-netbox sync. (duration: 03m 53s) [production]
22:43 <RoanKattouw> Running refreshMessageBlobs.php on all wikis for T222539 [production]
22:42 <crusnov@deploy1001> Started deploy [netbox/deploy@0061190]: Deploy new version of ganeti-netbox sync. [production]
21:59 <mutante> LDAP - remove 'sukhe' from 'nda' and add to 'wmf' instead (T221990) [production]
21:24 <cdanis> experimenting with different disk scheduler on ms-be2014 -- cdanis@ms-be2014.codfw.wmnet ~ % for D in /sys/block/sd*/queue/scheduler ; echo cfq | sudo tee $D [production]
21:15 <godog> swift codfw-prod: push up-to-date rings, mistakenly pushed earlier an older version [production]
19:48 <gehel> rolling restart of cassandra on maps* fro config change [production]
19:47 <RoanKattouw> Running recomputeNotifCounts.php --notif-types=login-success on all Echo wikis for T220762 [production]
19:31 <cdanis> cdanis@cumin1001.eqiad.wmnet ~ % sudo cumin -m async -b4 'ms-be1*' 'run-puppet-agent --enable "cdanis rollout I369f9b29"' 'systemctl restart swift-object-replicator' [production]
19:22 <cdanis> cdanis@cumin1001.eqiad.wmnet ~ % sudo cumin -m async -b4 'ms-be2*' 'run-puppet-agent --enable "cdanis rollout I369f9b29"' 'systemctl systemctl restart swift-object-replicator' [production]
19:01 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Begin homepage experiment on cswiki and kowiki (T221266) (duration: 00m 51s) [production]
18:47 <catrope@deploy1001> Synchronized php-1.34.0-wmf.3/extensions/GrowthExperiments/: Remove link to pageviews tool when no data available (T222405) (duration: 00m 52s) [production]
18:32 <catrope@deploy1001> Synchronized php-1.34.0-wmf.3/skins/MinervaNeue/includes/menu/Definitions.php: Harden Definitions::insertCommunityPortal() method (T222407) (duration: 00m 53s) [production]
18:30 <cdanis> cdanis@cumin1001.eqiad.wmnet ~ % sudo cumin 'ms-be*' 'disable-puppet "cdanis rollout I369f9b29"' [production]
18:24 <jynus> restart and upgrade db1116 [production]
18:14 <catrope@deploy1001> Synchronized wmf-config/CommonSettings.php: Set $wgOresFrontendBaseUrl (T219396) (duration: 00m 51s) [production]
17:53 <otto@deploy1001> scap-helm eventgate-main install -n main -f main/staging-values.yaml stable/eventgate [namespace: eventgate-main, clusters: staging] [production]
17:52 <otto@deploy1001> scap-helm eventgate-main install -n main -f main/staging-values.yaml stable/eventgate [namespace: eventgate-main, clusters: staging] [production]
17:19 <elukey> restart netbox on netmon1002 as test [production]
17:11 <jynus> restart dbprov* hosts, in sequence, for kernel upgrade [production]
16:42 <jynus> restart db1114 mysql for upgrade testing [production]
16:38 <andrewbogott> re-imaging cloudvirt1024 [production]
16:34 <jynus> restart db2102 mysql for upgrade testing [production]
16:11 <hashar> CI queue drained. Should be working fine again now [production]
15:57 <hashar> CI / Zuul is being slowed down and being investigated [production]
15:48 <moritzm> updating firmware-bnx2x (from stretch point release, this is a NOP, the source package firmware-nonfree was updated for various Wifi chipsets we don't use, doublechecked by comparing check sums for old and new bnx2x firmware) [production]
15:37 <moritzm> updating firmware-bnx2 (from stretch point release, this is a NOP, the source package firmware-nonfree was updated for various Wifi chipsets we don't use, doublechecked by comparing check sums for old and new bnx2 firmware) [production]
15:35 <papaul> shutting down elastic2038 for DIMM swap [production]
15:30 <moritzm> updating base-files from recent stretch point release [production]
15:14 <ema> pool cp4026 w/ ATS backend T219967 [production]
14:57 <godog> capture strace / core for rsyslog on wezen / lithium and restart - T199406 [production]
14:42 <ema> powercycle cp1083 [production]
14:41 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp1083.eqiad.wmnet [production]
14:35 <godog> swift eqiad-prod: finish decom ms-be101[45] - T220590 [production]
14:25 <moritzm> installing vips security updates [production]
14:19 <ema> depool cp4026 and reimage as upload_ats T219967 [production]
14:11 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
14:11 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]