2251-2300 of 10000 results (47ms)
2018-11-07 §
18:51 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T201285: Disable wgRawHTML on Governance wiki (duration: 05m 12s) [production]
18:31 <onimisionipe> restarting relforge-eqiad and relforge-eqiad-small-alpha clusters on relforge100[1-2] [production]
18:21 <XioNoX> power down asw-c4-codfw - T208272 [production]
17:31 <sbisson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472008|Add sourceswiki to wikidata clients]] (duration: 00m 53s) [production]
17:25 <sbisson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471947|Inject wikidata rc records on wikidata itself]] (duration: 00m 53s) [production]
17:21 <sbisson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472034|Enable WMEUnderstandingFirstDay on testwiki]] (duration: 00m 53s) [production]
16:37 <XioNoX> remove asw-c-codfw FPC8 from config - T208272 [production]
16:35 <XioNoX> shutdown asw-c-codfw FPC8 - T208272 [production]
16:33 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.3/resources/src/mediawiki.rcfilters/styles/mw.rcfilters.ui.less: T208898 Hot-deploy to wmf.3 (duration: 00m 53s) [production]
16:21 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.3/extensions/Echo/modules/styles: Hot-deploy T208930 to wmf.3 (duration: 00m 54s) [production]
16:20 <XioNoX> Enable all VC ports (except uplinks) on spines - T208272 [production]
15:58 <XioNoX> Redirect eqsin/ulsfo caches to eqiad - T208272 [production]
15:57 <XioNoX> depool codfw for row C maintenance - T208272 [production]
15:36 <moritzm> installing Java security updates on relforge* [production]
15:29 <jiji@deploy1001> Synchronized wmf-config/ProductionServices.php: Remove jobqueue_redis references, T198220 (duration: 00m 54s) [production]
15:21 <akosiaris> T206439 direct 30% of the apertium.svc.eqiad.wmnet traffic to scb1001. Will increase tomorrow to 50% [production]
15:20 <akosiaris@puppetmaster1001> conftool action : set/weight=15; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* [production]
15:16 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* [production]
15:15 <akosiaris> T206439 pool upgraded scb1001 to apertium.svc.eqiad.wmnet as a form of canary [production]
15:13 <moritzm> uploaded nginx 1.13.6-2+wmf2 to apt.wikimedia.org/stretch-wikimedia [production]
14:55 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* [production]
14:37 <oblivian@deploy1001> Synchronized docroot/wwwportal/w/search-redirect.php: Fixing redirects if no language is specified (duration: 00m 54s) [production]
14:33 <moritzm> uploaded nginx 1.13.6-2+wmf2~jessie1 to apt.wikimedia.org/jessie-wikimedia [production]
14:32 <akosiaris> T206439 upload apertium-cat_2.6.0-1+wmf1 apertium-fra-cat_1.5.0-1+wmf1 apertium-fra_1.5.0-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main [production]
14:26 <bblack> rebooting graphite1004 [production]
14:16 <akosiaris> T206439 upload apertium-separable_0.3.2-1+wmf1 apertium-lex-tools_0.2.1-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main [production]
14:07 <akosiaris> T206439 upload apertium_3.5.2-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main [production]
13:43 <bblack> hi [production]
13:21 <Amir1> ladsgroup@mwmaint1002:/srv/mediawiki/php-1.33.0-wmf.1$ mwscript sql.php --wiki=sourceswiki extensions/Wikibase/client/sql/entity_usage.sql (T208858) [production]
12:38 <zeljkof> EU SWAT finished [production]
12:36 <zfilipin@deploy1001> Synchronized wmf-config: SWAT: [[gerrit:471948|BC: Enable Schema.org page split test (T208763)]] (duration: 00m 54s) [production]
12:35 <akosiaris> T206439 upload hfst-ospell_0.5.0-1+wmf1to apt.wikimedia.org/jessie-wikimedia/main [production]
12:27 <akosiaris> T206439 upload cg3_1.1.7-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main [production]
12:16 <zfilipin@deploy1001> Synchronized wmf-config/InterwikiSortOrders.php: SWAT: [[gerrit:468337|Add dty, gor, inh, kbp and lfn to InterwikiSortOrders (T208217)]] (duration: 00m 53s) [production]
12:12 <zfilipin@deploy1001> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:472027|New throttle rule for Art&Feminism event in Chile (T208866)]] (duration: 00m 54s) [production]
12:12 <akosiaris> T206439 upload hfst_3.15.0-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main [production]
12:08 <zfilipin@deploy1001> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:472026|Remove expired throttle rules]] (duration: 01m 05s) [production]
11:49 <akosiaris> T206439 upload lttoolbox_3.5.0-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main [production]
11:49 <akosiaris> T206439 upload lttoolbox_3.5.0-1+wmf1 [production]
10:06 <hashar> CI: switched operations/puppet job to be based on Stretch ( T208422 ) and to add python3 ( T208873 ) [production]
09:25 <_joe_> run systemctl reset-failed on ms-be1029, had a failed debmonitor session [production]
08:16 <kartik@deploy1001> Finished deploy [cxserver/deploy@6f97d25]: Update cxserver to f9ffd24 (duration: 04m 59s) [production]
08:11 <kartik@deploy1001> Started deploy [cxserver/deploy@6f97d25]: Update cxserver to f9ffd24 [production]
02:55 <ejegg> disabled recurring charge jobs [production]
00:46 <mutante> tegmen - shutting down for renaming and reinstall (T208824) [production]
00:11 <dereckson@deploy1001> Synchronized wmf-config/interwiki.php: Updating interwiki cache (duration: 02m 44s) [production]
2018-11-06 §
23:55 <mutante> cp1084 - network went down, powercycled, probably T203194 [production]
22:49 <ejegg> updated fundraising CiviCRM from e0742d2210 to 769dcf6456 [production]
21:50 <mutante> icinga1001-"MediaWiki EtcdConfig up-to-date" checks were all UNKNOWN because systemd unit update-etcd-mw-config-lastindex was present but service not running. it was turned off in https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/427328/ on purpose. manually ran "systemctl start update-etcd-mw-config-lastindex" and the checks all work (T202782) [production]
21:49 <mutante> icinga1001 - the "MediaWiki EtcdConfig up-to-date" checks were all unknown on the new icinga server, this was because systemd unit update-etcd-mw-config-lastindex was present but service not running. that was turned off in https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/427328/ on purpose. manually ran "systemctl start update-etcd-mw-config-lastindex" to start it and the checks [production]