251-300 of 10000 results (50ms)
2018-10-22 §
05:29 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Clarify db2033 BBU status (duration: 00m 49s) [production]
04:37 <kartik@deploy1001> Finished deploy [cxserver/deploy@904151f]: Update cxserver to eee8974 (T207070, T203077, T199529) (duration: 05m 42s) [production]
04:31 <kartik@deploy1001> Started deploy [cxserver/deploy@904151f]: Update cxserver to eee8974 (T207070, T203077, T199529) [production]
2018-10-21 §
22:15 <onimisionipe> repooling wdqs1003 as it has caught up on lag [production]
20:42 <banyek> resuming replication on s4@dbstore2002 (T204930) [production]
16:15 <reedy@deploy1001> Synchronized wmf-config/interwiki.php: Updating interwiki cache (duration: 04m 52s) [production]
15:57 <bawolff> adjust patch for T194204 [production]
12:39 <onimisionipe> depooling wdqs1003 to catchup on lag time [production]
2018-10-20 §
23:05 <reedy@deploy1001> Synchronized php-1.32.0-wmf.26/extensions/CentralAuth/: Update setEmail (duration: 00m 55s) [production]
21:29 <gehel> repooling wdqs1003 (still some lag, but 100[45] start to be impacted) [production]
19:54 <gehel> depooling wdqs1003 to catch up on lag [production]
13:53 <reedy@deploy1001> Synchronized php-1.32.0-wmf.26/includes/auth/AuthManager.php: (no justification provided) (duration: 00m 55s) [production]
12:46 <hoo@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add CentralAuth related permissions to stewards at metawiki (T207531) (duration: 01m 09s) [production]
05:38 <marostegui> Force writeback on db2033 - T184888 [production]
2018-10-19 §
20:33 <twentyafterfour> deployed RCFilters: Fix completely broken highlight circles refs T207472 [production]
20:32 <twentyafterfour@deploy1001> Synchronized php-1.32.0-wmf.26/resources/src/mediawiki.rcfilters/styles/: sync https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468636/ (duration: 00m 54s) [production]
20:31 <twentyafterfour> deploying https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468636/ to the full cluster. [production]
20:28 <twentyafterfour> deployed https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468636/ to mwdebug1002 [production]
19:20 <mutante> ns0 / ns1 - authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsdctl reload-zones - to add new language shn (T206777) [production]
19:16 <mutante> ns2/multatuli - gnddctl reload-zones [production]
19:12 <mutante> labweb1001 / wikitech - disabling 2fa for myself, logging in , re-enabling it again [production]
17:49 <ejegg> updated fundraising CiviCRM from 83874e75ba to 1f10dc8a18 [production]
17:47 <mutante> DNS - 'authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsd checkconf && gdnsd reload-zones' - needed when adding new languages to langs.tmpl - adding "shn" (Shan language) T206777 [production]
16:36 <XioNoX> deactivate BGP to 15426 in ams-ix (down and no reply to emails) - T207428 [production]
14:16 <banyek> disconnecting s4 replication on dbstore2002 (T204930) [production]
14:12 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove useless comments (duration: 00m 54s) [production]
13:58 <vgutierrez> Uploaded certcentral 0.2 to apt.wikimedia.org (stretch) - T207457 [production]
11:46 <banyek> starting compression of s4 tables @dbstore2002 (T204930) [production]
11:33 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T207313 UBN - Revert back wikidata for change_tag backend (duration: 00m 59s) [production]
10:53 <arturo> icinga downtime for 2h for clounet1003/1004 to deploy patch related to T206261 [production]
09:37 <godog> bump /proc/sys/net/core/rmem_default temporarily to 6MB and bounce statsd-proxy statsite-instances on graphite1004 - T196484 [production]
08:53 <banyek> adding wmf-pt-kill_2.2.20-1+wmf4 package for stretch (T206521) [production]
08:28 <jynus> stopping db1092 and db1087 in sync [production]
07:50 <godog> bump /proc/sys/net/core/rmem_default temporarily to 2MB and bounce statsd-proxy statsite-instances on graphite1004 - T196484 [production]
07:20 <marostegui> Remove mwmaint1001 grants from m5 - https://phabricator.wikimedia.org/T201343 https://phabricator.wikimedia.org/T192457 [production]
07:15 <godog> powercycle ms-be1021, [19601329.556259] sd 0:1:0:1: rejecting I/O to offline device [production]
07:05 <godog> bump /proc/sys/net/core/rmem_default temporarily to 1MB and bounce statsd-proxy statsite-instances on graphite1004 - T196484 [production]
06:13 <marostegui> Deploy schema change on s7 codfw host by host without replication - T204006 [production]
05:58 <marostegui> Deploy schema change on s2 codfw host by host without replication - T204006 [production]
05:25 <marostegui> Deploy schema change on s1 codfw host by host without replication - T204006 [production]
01:49 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.26/extensions/WikimediaEvents/includes/WikimediaEventsHooks.php: Ic74a9d5601b8c (duration: 00m 55s) [production]
2018-10-18 §
22:00 <mutante> lvs1011,lvs1012 - manually editing nagios NRPE config and restarting service (to make monitoring from icinga1001 work and puppet is disabled) [production]
21:52 <mutante> eeden - manually editing nagios NRPE config and restarting service (to make monitoring from icinga1001 work and puppet is disabled) [production]
21:49 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group2 wikis to 1.32.0-wmf.26 refs T191072 [production]
21:46 <twentyafterfour@deploy1001> Synchronized php-1.32.0-wmf.26/includes/filerepo/file/LocalFile.php: sync Id97e1c7c2655d90928c777bc3377e5ea23f49f6b refs T207419 (duration: 00m 53s) [production]
21:29 <twentyafterfour@deploy1001> Synchronized php-1.32.0-wmf.26/includes/filerepo/file/LocalFile.php: sync https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/468470/ refs T207419 (duration: 00m 54s) [production]
20:49 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group2 wikis to 1.32.0-wmf.24 refs T191072 [production]
20:39 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.26 [production]
20:21 <volans> start ferm on db2042, it failed to start at reboot due to DNS resolution timeout [production]
19:22 <ejegg> updated SmashPig standalone deploy from 5f21d3f2db to 581c685326 [production]