751-800 of 10000 results (65ms)
2019-09-11 §
17:43 <ayounsi@deploy1001> Finished deploy [librenms/librenms@2a06e98]: Upgrade LibreNMS to 1.55 - T232599 (duration: 00m 09s) [production]
17:42 <ayounsi@deploy1001> Started deploy [librenms/librenms@2a06e98]: Upgrade LibreNMS to 1.55 - T232599 [production]
17:32 <bblack> enable GRE MTU mitigation on eqsin caches (cp5xxx) - T232602 [production]
17:27 <bblack> restbase2009 - re-pool - T227408 [production]
17:07 <bblack> restbase2009 - shutdown for hardware work - T227408 [production]
17:05 <bblack> restbase2009 - depool for hardware work - T227408 [production]
16:56 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.21/extensions/GrowthExperiments/modules/homepage/ext.growthExperiments.StartModule.less: SWAT: c0fd061: Homepage: Fix start module layout bugs (T230629, T232549, T225668) (duration: 01m 02s) [production]
16:54 <bblack> manually removed decommed eventbus LVS IP on kafka100[23] [production]
16:54 <bblack> manually removed decommed eventbus LVS IP on kafka-main1001 [production]
16:50 <bblack> manually removed decommed eventbus LVS IP on kafka-main200[23] [production]
16:49 <bblack> manually removed decommed eventbus LVS IP on kafka-main2001 [production]
16:42 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 6007fbc: [rowiki] Allow sysops to remove patrollers (T231099) (duration: 01m 03s) [production]
16:39 <urandom> decommissioning Cassandra, restbase1018-a -- T224553 [production]
16:38 <Urbanecm> Run mwscript emptyUserGroup.php --wiki=fawiki OTRS-member (T232554) [production]
16:36 <bblack> ran conftool-merge on puppetmaster1001 (manually from sudo -i, to fixup missing updates) [production]
16:35 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 76991f2: Remove OTRS-member usergroup from fawiki (T232554) (duration: 01m 05s) [production]
16:32 <Urbanecm> mwscript importImages.php --wiki=commonswiki --user=Abbe98 --comment-ext=txt /home/urbanecm/T232346 [production]
16:31 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.22/extensions/GrowthExperiments/modules/homepage/ext.growthExperiments.StartModule.less: SWAT: c45d6d0: Homepage: Fix start module layout bugs (T230629, T232549, T225668) (duration: 01m 03s) [production]
16:28 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 565fafa: Set noindex for user and user_talk on zhwiki (T231982) (duration: 01m 05s) [production]
16:24 <urandom> bootstrapping Cassandra, restbase-dev1005-a -- T224554 [production]
16:16 <bblack@cumin1001> conftool action : set/pooled=no; selector: cluster=eventbus [production]
16:10 <urbanecm@deploy1001> Synchronized wmf-config/throttle.php: SWAT: 510aa6b: Add new whitelist rule for Université de Lorraine course (T232596) (duration: 01m 04s) [production]
16:07 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: eceaccf: Add autopatrolled user group to az.wikibooks (T231493) (duration: 01m 06s) [production]
15:52 <bblack> lvs1015 - remove eventbus.svc.eqiad.wmnet service, restart pybal, etc [production]
15:51 <bblack> lvs2003 - remove eventbus.svc.codfw.wmnet service, restart pybal, etc [production]
15:49 <bblack> lvs1016 - remove eventbus.svc.eqiad.wmnet service, restart pybal, etc [production]
15:48 <bblack> lvs2006 - remove eventbus.svc.codfw.wmnet service, restart pybal, etc [production]
15:03 <bblack> downtimed dns-discovery confd health checks for eventbus - T232122 [production]
13:13 <hashar@deploy1001> Synchronized php: group1 wikis to 1.34.0-wmf.22 (duration: 01m 02s) [production]
13:12 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.22 [production]
12:48 <moritzm> upgrade labpuppetmaster* to use facter 3 / puppet 5 [production]
12:40 <moritzm> removing now obsolete puppet/puppetdb packages from labpuppetmaster* T171188 [production]
12:40 <moritzm> removing now puppet/puppetdb packages from labpuppetmaster* T171188 [production]
11:59 <hashar> Restarting Gerrit due to deadlock in the account cache # T224448 [production]
11:57 <bblack> applying GRE MTU -> MSS fixup to cobalt and gerrit2001 - T218184 [production]
11:41 <Amir1> EU SWAT is done [production]
11:40 <ladsgroup@deploy1001> Synchronized php-1.34.0-wmf.21/maintenance/getReplicaServer.php: SWAT: [[gerrit:535217|maintenance/getReplicaServer.php: Remove reference to long-deleted config var (T232268)]] (duration: 01m 04s) [production]
11:29 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:535615|Disable AMC Outreach modal (T231436)]] (duration: 01m 04s) [production]
11:15 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:535815|Set item terms on write both up to Q10mio (T225055)]] (duration: 01m 03s) [production]
11:10 <ladsgroup@deploy1001> Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:535567|TR: set WikibaseTaintedReferencesEnabled true on labs wikidatawiki (T232191)]] (duration: 01m 03s) [production]
10:57 <mobrovac> drop the wiktionary definition keyspace - T231361 [production]
10:23 <moritzm> removed roentgenium/tureis in Ganeti T224559 [production]
10:18 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:18 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
10:17 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
10:17 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
10:01 <jynus> stopping and upgrading db1074 [production]
09:56 <jynus> upgrading mariadb client libary on mariadb root clients [production]
09:46 <jiji@deploy1001> Synchronized wmf-config/CommonSettings.php: Push PHP7 traffic to 50% - T219150 (duration: 01m 03s) [production]
09:45 <mobrovac@deploy1001> Finished deploy [restbase/deploy@cf2ca76]: Stop using storage for enwiktionary definition and expose new PCS javascript endpoints, take #3a (duration: 12m 15s) [production]