3751-3800 of 10000 results (50ms)
2018-10-20 §
19:54 <gehel> depooling wdqs1003 to catch up on lag [production]
13:53 <reedy@deploy1001> Synchronized php-1.32.0-wmf.26/includes/auth/AuthManager.php: (no justification provided) (duration: 00m 55s) [production]
12:46 <hoo@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add CentralAuth related permissions to stewards at metawiki (T207531) (duration: 01m 09s) [production]
05:38 <marostegui> Force writeback on db2033 - T184888 [production]
2018-10-19 §
20:33 <twentyafterfour> deployed RCFilters: Fix completely broken highlight circles refs T207472 [production]
20:32 <twentyafterfour@deploy1001> Synchronized php-1.32.0-wmf.26/resources/src/mediawiki.rcfilters/styles/: sync https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468636/ (duration: 00m 54s) [production]
20:31 <twentyafterfour> deploying https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468636/ to the full cluster. [production]
20:28 <twentyafterfour> deployed https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468636/ to mwdebug1002 [production]
20:24 <gtirloni> temporarily increased project quota (T204562) [shinken]
19:39 <andrewbogott> migrating project to eqiad1 [striker]
19:20 <mutante> ns0 / ns1 - authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsdctl reload-zones - to add new language shn (T206777) [production]
19:16 <mutante> ns2/multatuli - gnddctl reload-zones [production]
19:12 <mutante> labweb1001 / wikitech - disabling 2fa for myself, logging in , re-enabling it again [production]
18:47 <andrewbogott> migrating project to eqiad1 [planet]
18:31 <andrewbogott> migrating VMs to eqiad1 [general-k8s]
17:49 <ejegg> updated fundraising CiviCRM from 83874e75ba to 1f10dc8a18 [production]
17:47 <mutante> DNS - 'authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsd checkconf && gdnsd reload-zones' - needed when adding new languages to langs.tmpl - adding "shn" (Shan language) T206777 [production]
16:36 <XioNoX> deactivate BGP to 15426 in ams-ix (down and no reply to emails) - T207428 [production]
15:05 <andrewbogott> moving the Glampipe VM to labvirt1010 and shutting down as that project is unclaimed on https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge [glampipe]
14:17 <andrewbogott> moving tools-clushmaster-01 to labvirt1004 [tools]
14:16 <banyek> disconnecting s4 replication on dbstore2002 (T204930) [production]
14:12 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove useless comments (duration: 00m 54s) [production]
13:58 <vgutierrez> Uploaded certcentral 0.2 to apt.wikimedia.org (stretch) - T207457 [production]
12:02 <arturo> revert change in dmz_cidr in eqiad1 for now (T206261) [admin]
11:46 <banyek> starting compression of s4 tables @dbstore2002 (T204930) [production]
11:36 <hashar> nuking some caches on castor02.integration.eqiad.wmflabs to free up disk space [releng]
11:33 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T207313 UBN - Revert back wikidata for change_tag backend (duration: 00m 59s) [production]
11:16 <arturo> change in dmz_cidr in eqiad1: VMs will connect between them without NAT even when using floating IPs (T206261) [admin]
10:53 <arturo> icinga downtime for 2h for clounet1003/1004 to deploy patch related to T206261 [production]
10:14 <arturo> we have new virt servers in the eqiad1 deployment since past week and this week: cloudvirt1018, cloudvirt1023, cloudvirt1024 [admin]
09:37 <godog> bump /proc/sys/net/core/rmem_default temporarily to 6MB and bounce statsd-proxy statsite-instances on graphite1004 - T196484 [production]
08:53 <banyek> adding wmf-pt-kill_2.2.20-1+wmf4 package for stretch (T206521) [production]
08:28 <jynus> stopping db1092 and db1087 in sync [production]
07:50 <godog> bump /proc/sys/net/core/rmem_default temporarily to 2MB and bounce statsd-proxy statsite-instances on graphite1004 - T196484 [production]
07:20 <marostegui> Remove mwmaint1001 grants from m5 - https://phabricator.wikimedia.org/T201343 https://phabricator.wikimedia.org/T192457 [production]
07:15 <godog> powercycle ms-be1021, [19601329.556259] sd 0:1:0:1: rejecting I/O to offline device [production]
07:08 <legoktm> also deploying https://gerrit.wikimedia.org/r/c/integration/config/+/468022 [releng]
07:07 <legoktm> deploying https://gerrit.wikimedia.org/r/467329 https://gerrit.wikimedia.org/r/468417 https://gerrit.wikimedia.org/r/468393 https://gerrit.wikimedia.org/r/467724 [releng]
07:05 <godog> bump /proc/sys/net/core/rmem_default temporarily to 1MB and bounce statsd-proxy statsite-instances on graphite1004 - T196484 [production]
06:13 <marostegui> Deploy schema change on s7 codfw host by host without replication - T204006 [production]
05:58 <marostegui> Deploy schema change on s2 codfw host by host without replication - T204006 [production]
05:25 <marostegui> Deploy schema change on s1 codfw host by host without replication - T204006 [production]
01:49 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.26/extensions/WikimediaEvents/includes/WikimediaEventsHooks.php: Ic74a9d5601b8c (duration: 00m 55s) [production]
00:29 <andrewbogott> migrating tools-exec-1411 and tools-exec-1410 off of cloudvirt1017 [tools]
2018-10-18 §
22:00 <mutante> lvs1011,lvs1012 - manually editing nagios NRPE config and restarting service (to make monitoring from icinga1001 work and puppet is disabled) [production]
21:52 <mutante> eeden - manually editing nagios NRPE config and restarting service (to make monitoring from icinga1001 work and puppet is disabled) [production]
21:49 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group2 wikis to 1.32.0-wmf.26 refs T191072 [production]
21:46 <twentyafterfour@deploy1001> Synchronized php-1.32.0-wmf.26/includes/filerepo/file/LocalFile.php: sync Id97e1c7c2655d90928c777bc3377e5ea23f49f6b refs T207419 (duration: 00m 53s) [production]
21:29 <twentyafterfour@deploy1001> Synchronized php-1.32.0-wmf.26/includes/filerepo/file/LocalFile.php: sync https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468470/ refs T207419 (duration: 00m 54s) [production]
20:49 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group2 wikis to 1.32.0-wmf.24 refs T191072 [production]