3301-3350 of 10000 results (55ms)
2018-07-30 §
07:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Add db1120 to x1 T196376 (duration: 00m 54s) [production]
07:28 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Add db1120 to x1 T196376 (duration: 00m 59s) [production]
05:28 <marostegui> Deploy schema change on db1068 (commonswiki master) - T51190 [production]
05:00 <marostegui> Deploy schema change on db1062 (s7 primary master) T144010 T51190 T199368 [production]
03:13 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Mon Jul 30 03:13:42 UTC 2018 (duration 10m 29s) [production]
03:03 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.14) (duration: 15m 33s) [production]
02:28 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.13) (duration: 11m 41s) [production]
2018-07-29 §
09:56 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool pc2006 T200641 (duration: 00m 57s) [production]
02:34 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: Neuter EducationProgram T188410 (duration: 00m 58s) [production]
2018-07-28 §
17:49 <Krinkle> Navigation Timing alerts indicate we're losing a significant about of traffic [production]
17:35 <elukey> restart eventlogging on eventlog1002 after tons of kafka disconnects (still not clear what happened) [production]
08:16 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1094 fully (duration: 00m 57s) [production]
2018-07-27 §
22:05 <ejegg> updated payments-wiki from f0138ab066 to 8c4d6aaa13 [production]
21:39 <ejegg> updated payments-wiki from 5e01f50983 to f0138ab066 [production]
20:40 <SMalyshev> re-pooled wdqs1003 [production]
19:04 <mutante> terbium is being removed from ferm rules on elasticsearch/relforge, logstash/collector, mariadb/labtestwikitech and mw-maintenance itself (T192092) [production]
18:57 <SMalyshev> temporarily depooled wdq1003 to let it catch up with lag [production]
18:15 <mutante> syncing home dirs from mwmaint1001 to mwmaint2001 (once, manually, not currently set to auto-sync, but to keep another copy of former terbium homes in case we failover) (T192092) [production]
18:12 <mutante> terbium: deleting rsyncd config fragment, stopping rsyncd, not used anymore, decom prep [production]
17:06 <gehel> repooling wdqs1003 [production]
16:43 <gehel> depooling wdqs1003 to let it catch up on update lag [production]
15:24 <joal@deploy1001> Finished deploy [analytics/aqs/deploy@6fafc63]: Update AQS new-pages metric (duration: 04m 12s) [production]
15:20 <joal@deploy1001> Started deploy [analytics/aqs/deploy@6fafc63]: Update AQS new-pages metric [production]
15:06 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1094 with low load (duration: 00m 55s) [production]
14:36 <mutante> terbium - removing accountcheck cron job (duplicate mail from the same thing now on mwmaint1001) [production]
14:23 <jynus> stop and reimage db1094 [production]
14:18 <elukey> execute echo 'https://wikimania.wikimedia.org' | mwscript purgeList.php on mwmain1001 [production]
13:27 <ema> libvmod-re2 1.3.1-2 uploaded to stretch-wikimedia T200445 [production]
13:15 <ema> libvmod-netmapper 1.7-2 uploaded to stretch-wikimedia T200445 [production]
13:09 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1094 for reimage (duration: 00m 54s) [production]
11:33 <mobrovac@deploy1001> Finished deploy [eventstreams/deploy@941e3cf]: Make the main processing loop async - T199813 (duration: 02m 02s) [production]
11:31 <mobrovac@deploy1001> Started deploy [eventstreams/deploy@941e3cf]: Make the main processing loop async - T199813 [production]
09:37 <ema> vhtcpd 0.1.1-2 uploaded to stretch-wikimedia T200445 [production]
09:00 <godog> adjust aggregation to 'sum' for MediaWiki.edit sum metrics - T199968 [production]
08:36 <Amir1> ladsgroup@mwmaint1001:~$ foreachwikiindblist s3 populateChangeTagDef.php --sleep 2 (T193873) [production]
05:59 <akosiaris> reboot webperf1002, webperf2002 for new disk to appear T199853 [production]
05:19 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1094 (duration: 00m 55s) [production]
04:59 <marostegui> Deploy schema change on db1094 T144010 T51190 T199368 [production]
04:58 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1094 (duration: 00m 57s) [production]
01:19 <aaron@deploy1001> Synchronized php-1.32.0-wmf.14/includes/libs/objectcache/BagOStuff.php: f208a431f912 (duration: 00m 56s) [production]
2018-07-26 §
23:04 <XioNoX> depool ulsfo, outages on both physical links to the site [production]
21:57 <ejegg> updated payments-wiki from 6390e50abd to 5e01f50983 [production]
21:32 <tgr@deploy1001> Synchronized php-1.32.0-wmf.14/includes/Title.php: SWAT T200456: Handle $title === null in Title::newFromText (duration: 00m 57s) [production]
21:22 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: T200346 Update custom domain for thumbnail rendering (duration: 00m 54s) [production]
21:21 <tgr@deploy1001> Synchronized wmf-config/LabsServices.php: SWAT: T200346 Update custom domain for thumbnail rendering (duration: 00m 54s) [production]
21:19 <tgr@deploy1001> Synchronized wmf-config/ProductionServices.php: SWAT: T200346 Update custom domain for thumbnail rendering (duration: 00m 55s) [production]
21:12 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: T190015 gerrit 421122 + 421123 prepare for interface-admin group (duration: 00m 54s) [production]
21:11 <tgr@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: T190015 gerrit 421122 + 421123 prepare for interface-admin group (duration: 00m 55s) [production]
20:55 <tgr@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: Do not set deprecated value for $wgExternalDiffEngine (duration: 00m 54s) [production]
20:39 <addshore@deploy1001> Synchronized php-1.32.0-wmf.14/extensions/Wikibase/repo/includes/Store/Sql/SqlChangeDispatchCoordinator.php: Use getClientLockName value for releaseClientLock when dispatching T200420 (duration: 00m 57s) [production]