1201-1250 of 10000 results (52ms)
2018-05-25 §
05:25 <marostegui> Stop MySQL on db1116 to copy its content to db1124 - T190704 [production]
05:23 <marostegui> Deploy schema change on db1089 - T190148 T191519 T188299 [production]
05:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 for alter table (duration: 01m 20s) [production]
05:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 after alter table (duration: 01m 21s) [production]
05:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1109 for alter table (duration: 01m 20s) [production]
05:05 <marostegui> Add tmp1 index back to db1109 - T194273 [production]
04:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1104 after alter table (duration: 01m 21s) [production]
03:10 <papaul> OS install on db209[4-5] [production]
2018-05-24 §
23:13 <ladsgroup@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase: Dumps: Allow several --entity-type arguments (T195420) (duration: 02m 25s) [production]
22:21 <ladsgroup@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase/lib/includes/Store/Sql/TermSqlIndex.php: Log the query that would hit wb_terms. (T195520) (duration: 01m 20s) [production]
22:11 <ladsgroup@tin> Synchronized php-1.32.0-wmf.4/extensions/Wikibase/lib/includes/Store/Sql/TermSqlIndex.php: Log the query that would hit wb_terms. (T195520) (duration: 01m 21s) [production]
20:58 <marostegui> Add tmp1 index back on db1104 [production]
20:57 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1104 for alter table (duration: 01m 20s) [production]
20:56 <legoktm@tin> Synchronized php-1.32.0-wmf.5/extensions/VisualEditor/: no-op, sync with git state (duration: 01m 21s) [production]
20:54 <legoktm@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase/lib/includes/Store/Sql/TermSqlIndex.php: no-op, sync with git state (duration: 01m 20s) [production]
20:41 <legoktm@tin> Synchronized php-1.32.0-wmf.4/extensions/Wikibase/lib/includes/Store/Sql/TermSqlIndex.php: no-op, sync with git state (duration: 01m 20s) [production]
20:17 <legoktm@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase/lib/includes/Store/Sql/TermSqlIndex.php: wmf.5 this time (duration: 01m 19s) [production]
20:14 <legoktm@tin> Synchronized php-1.32.0-wmf.4/extensions/Wikibase/lib/includes/Store/Sql/TermSqlIndex.php: Add debug logging (duration: 01m 19s) [production]
20:11 <legoktm@tin> Synchronized php-1.32.0-wmf.4/extensions/Wikibase/lib/includes/Store/Sql/TermSqlIndex.php: Disable TermSqlIndex::getMatchingTerms (duration: 01m 20s) [production]
19:49 <ejegg> updated payments-wiki from c81e25f8d3 to 43989ebc96 [production]
19:44 <reedy@tin> Synchronized wmf-config/Wikibase.php: Disable PropSuggester (duration: 01m 21s) [production]
19:30 <twentyafterfour@tin> scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) [production]
19:14 <twentyafterfour> Starting the MediaWiki train for Thursday May 24, today I will be deploying wmf/1.32.0-wmf.5 to all wikis [production]
18:31 <mutante> netmon1002, netmon2001: systemctl mask uwsgi; systemctl reset-failed - to fix Icinga alert about broken DPKG since last netbox deploy and to match existing status on labtestweb2001 [production]
18:21 <XioNoX> repool esams [production]
18:01 <no_justification> gerrit restarting on cobalt, back soon [production]
17:50 <mutante> mwdebug1001 - apt-get remove to clean up packages in "non ii" states [production]
16:59 <anomie> Running populateExternallinksIndex60.php on group 1 for T59176 [production]
16:50 <XioNoX> depooled esams - investigating issues [production]
16:31 <anomie> Running deduplicateArchiveRevId.php on group 2 for T193180 [production]
16:28 <jynus> manually failover the backup host for m2 to db1117:3322 [production]
16:22 <mutante> tin apt-get clean saved 7% disk space on / - fixing disk space alert [production]
16:19 <marostegui> Deploy schema change on db1099:3311 - T191519 T188299 T190148 [production]
16:19 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1099:3311 for alter table (duration: 01m 13s) [production]
16:16 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 after alter table (duration: 01m 17s) [production]
16:15 <addshore@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase/repo/maintenance/dispatchChanges.php: [[gerrit:434940|Dont use WikibaseRepo class in dispatchChanges constructor]] (duration: 10m 28s) [production]
16:13 <mutante> deploy2001 - let mwdeploy own .~tmp~ in /srv/mediawiki-staging [production]
15:48 <cmjohnson> swapped failed disk 0 db1065 [production]
15:06 <moritzm> installing glibc updates from stretch point release [production]
14:57 <marostegui> Deploy schema change on dbstore1001:s1 - T191519 T188299 T190148 [production]
14:56 <papaul> shutting down elastic2020 for maintenance [production]
14:51 <moritzm> upgrading mwdebug servers in eqiad to wikidiff 1.7.0 [production]
14:09 <akosiaris> empty ganeti2004 for stretch reimage [production]
14:00 <mutante> deploy2001: scap pull to sync. then add as scap master and host (gerrit:433616) [production]
13:37 <akosiaris> rebalance row_A codfw ganeti nodegroup. Fully upgrade to stretch now [production]
13:33 <marostegui> Deploy schema change on db1067 - T191519 T188299 T190148 [production]
13:32 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1067 for alter table (duration: 01m 00s) [production]
13:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1080 after alter table (duration: 00m 56s) [production]
13:27 <anomie> Running deduplicateArchiveRevId.php on group 1 for T193180 [production]
13:25 <moritzm> upgrading mw1262-mw1265 (canary hosts) to wikidiff 1.7.0 [production]