8301-8350 of 10000 results (67ms)
2017-10-18 §
11:21 <moritzm> upgrading mw1261 to wikidiff2 1.5.1 [production]
11:11 <mobrovac@tin> Finished deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now), part #2 (duration: 08m 53s) [production]
11:03 <mobrovac@tin> Started deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now), part #2 [production]
11:02 <mobrovac@tin> Finished deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now) (duration: 05m 23s) [production]
10:57 <mobrovac@tin> Started deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now) [production]
10:50 <moritzm> rebooting multatuli for kernel update [production]
10:21 <moritzm> imported linux 4.9.30-2+deb9u5~bpo8+1 for jessie-wikimedia [production]
09:51 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1098, depool db1082 (crashed) (duration: 00m 50s) [production]
09:39 <moritzm> installing xserver/xvfb security updates [production]
09:36 <jynus> reloading dbproxy1010's haproxy configuration [production]
09:30 <elukey> drop MobileWikiAppToCInteraction_10375484_15423246 from the log database on dbstore1002,db1047,db1046 - T177960 [production]
08:41 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Re-enable Statement usage tracking on cawiki (T151717) (duration: 00m 50s) [production]
08:25 <marostegui> Stop MySQL on db2019 to copy its data to db2084 - T178359 [production]
08:23 <mobrovac@tin> Finished deploy [changeprop/deploy@065a06e]: Bug fix: Apply ignore_errors on a per-request basis (duration: 01m 17s) [production]
08:22 <mobrovac@tin> Started deploy [changeprop/deploy@065a06e]: Bug fix: Apply ignore_errors on a per-request basis [production]
08:09 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Enable description usage tracking on a few test wikis (T177155) (duration: 00m 50s) [production]
07:49 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1056 - T174509 (duration: 00m 49s) [production]
07:46 <marostegui> Optimize pagelinks and templatelinks on db1056 - T174509 [production]
07:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1034 - T174509 (duration: 00m 59s) [production]
07:14 <gehel> depooling wdqs1003 until it catches up on updates [production]
07:02 <marostegui> Stop MySQL on db2079 to copy its data to db2084 - T178359 [production]
06:46 <_joe_> powercycling wdqs1003 [production]
05:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1072 - T164488 (duration: 00m 49s) [production]
05:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1055 - T174509 (duration: 00m 50s) [production]
05:40 <marostegui> Optimize pagelinks and templatelinks on db1055 - T174509 [production]
05:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1098 - T174509 (duration: 00m 49s) [production]
05:36 <marostegui> Optimize pagelinks and templatelinks on db1098 - T174509 [production]
05:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T174509 (duration: 00m 50s) [production]
05:25 <marostegui> Optimize pagelinks and templatelinks on db1102 for s2 - T174509 [production]
03:17 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Oct 18 03:17:01 UTC 2017 (duration 7m 3s) [production]
03:09 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.4) (duration: 14m 58s) [production]
02:33 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.3) (duration: 08m 21s) [production]
2017-10-17 §
23:31 <thcipriani@tin> Synchronized php-1.31.0-wmf.4/extensions/Citoid/modules/ve.ui.CiteFromIdInspector.css: SWAT: [[gerrit:384817|ve.ui.CiteFromIdInspector: Fix CSS for context menus after changes in OOjs UI]] T178324 (duration: 00m 50s) [production]
23:29 <thcipriani@tin> Synchronized php-1.31.0-wmf.4/extensions/VisualEditor/modules/ve-mw/ui/styles/widgets/ve.ui.MWMediaInfoFieldWidget.css: SWAT: [[gerrit:384748|ve.ui.MWMediaInfoFieldWidget: Fix positioning of icons]] T178415 (duration: 00m 50s) [production]
23:22 <thcipriani@tin> Synchronized php-1.31.0-wmf.3/includes/shell/Command.php: SWAT: [[gerrit:384790|Shell\Command: Better walltime fallback]] T178314 (duration: 00m 51s) [production]
23:15 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:366869|Remove setting no longer in MediaWiki]] (duration: 00m 50s) [production]
23:06 <mutante> disabling Icinga notifications for service recommendation_api on scb hosts - please remember to re-enable once ticket is resolved (T178445) (https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=recommendation_api%20endpoints) [production]
22:28 <ejegg> updated CiviCRM from fb513ccaa0bd7a13862aaa2b6fdd94ed97ef81df to 7c26791589af7ee2798def303aaaf863038a65c9 [production]
21:55 <foks> Removed 2FA from User:Amakuru [production]
21:39 <robh> cp4026 being returned to service post memory replacement. puppet runs fine and all icinga checks are green. repooled. [production]
21:23 <robh> cp4026 coming down for memory swap, no point in maint moding the system since other cp checks will alert anyhow [production]
20:14 <mutante> gerrit2001 - re-enabled puppet, attempting restart with --slave after gerrit:384758 [production]
19:54 <mutante> cobalt - re-enabled puppet, ran puppet, systemd says gerrit is active(running) [production]
19:51 <mutante> cobalt - stopping gerrit service, confirming pid file gets removed, move /etc/init.d/gerrit to /root [production]
19:50 <mutante> short gerrit downtime for systemd change coming up [production]
19:23 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.4 [production]
19:06 <mutante> gerrit2001 - rebooting to verify systemd change and service comes back properly [production]
18:53 <mutante> gerrit2001: stopping the gerrit service [production]
18:52 <mutante> cobalt: temp disable puppet | gerrit2001: stop puppet [production]
18:22 <paravoid> rebooting sodium for kernel/distro upgrade [production]