401-450 of 10000 results (47ms)
2018-12-14 §
09:28 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2049, db2059, db2070 after mysql and kernel upgrade (duration: 00m 45s) [production]
09:21 <banyek> global user rename is in progress - T209488 [production]
08:58 <marostegui> Stop MySQL on db2049, db2059 and db2070 for mysql and kernel upgrade [production]
08:56 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2049, db2059, db2070 for mysql and kernel upgrade (duration: 00m 43s) [production]
08:50 <elukey> swap oxygen with weblog1001 [production]
08:48 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2084 and db2088 after mysql and kernel upgrade (duration: 00m 44s) [production]
08:47 <elukey> disabled kafkatee-webrequest logstash output on oxygen (prep step before weblog1001) [production]
07:58 <marostegui> Deploy schema change on dbstore1002:s3 T86338 T202167 [production]
07:49 <marostegui> Upgrade mysql and kernel on db2084 and db2088 [production]
07:49 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2084 and db2088 for mysql and kernel upgrade (duration: 00m 45s) [production]
06:54 <marostegui> Deploy schema change on db2043 (s3 codfw master) - this will generate lag on s3 codfw T86338 T202167 [production]
06:53 <marostegui> Deploy schema change on db2043 (s3 codfw master) - this will generate lag on s3 codfw T86338 T20216 [production]
06:14 <marostegui> Deploy schema change on db1062 (s7 primary master) T86338 T202167 [production]
06:14 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1094 T86338 T202167 (duration: 00m 44s) [production]
06:10 <marostegui> Deployed schema change on db1094 T86338 T202167 [production]
05:55 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1094 T86338 T202167 (duration: 00m 47s) [production]
01:39 <mutante> install2002 deleted /srv/ contents,then mounted /mnt/vdb on /srv so same content but now / is used only 7% and /srv 57% (T211850) [production]
00:43 <mutante> install2002 (T211850) restarted instance, created ext4 filesystem on new /dev/vdb, mounted on /mnt/vdb, rsyncing /srv/ to /mnt/vdb/ [production]
00:33 <mutante> rebooting install2002 via ganeti2003, to add new virtual disk [production]
00:31 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Enforce a 10-byte password for +staff users, I4ecac70e (duration: 00m 44s) [production]
00:27 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT I7867277d Make wmgBabelMainCategory consistent for sr* wikis (duration: 00m 45s) [production]
2018-12-13 §
23:57 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T208246: Increase default minimum new password length to 10 for privileged groups (duration: 00m 44s) [production]
23:17 <andrew@deploy1001> Finished deploy [horizon/deploy@18c4ca6]: Rolling out fix for T131367 (duration: 03m 25s) [production]
23:13 <andrew@deploy1001> Started deploy [horizon/deploy@18c4ca6]: Rolling out fix for T131367 [production]
22:31 <reedy@deploy1001> Synchronized php-1.33.0-wmf.8/includes/http/HttpRequestFactory.php: T211886 (duration: 00m 44s) [production]
22:29 <reedy@deploy1001> Synchronized php-1.33.0-wmf.8/extensions/MobileFrontend: T211903 (duration: 00m 48s) [production]
21:55 <mutante> Ganeti - creating new 120G virtual disk on install2002 (T211850) [production]
21:00 <otto@deploy1001> Finished deploy [analytics/superset/deploy@UNKNOWN]: revert to version 0.26.3 (duration: 00m 32s) [production]
20:59 <otto@deploy1001> Started deploy [analytics/superset/deploy@UNKNOWN]: revert to version 0.26.3 [production]
20:33 <dcausse> creating 300+ wikis indices in elastic-psi @eqiad and @codfw [production]
20:21 <volans> imported elasticsearch-curator_5.2.0-1~deb9u1 into apt.w.o stretch-wikimedia component/spicerack - T205884 [production]
20:10 <mutante> LDAP - added mneisler to wmf (T211742) - existing shell user, so no gerrit change needed [production]
19:53 <hoo> Ran scap pull on snapshot1005 to undo live changes done for dump performance testing [production]
19:49 <dcausse> creating 300 wiki indices in elastic-omega@eqiad [production]
19:46 <dcausse> SF Morning SWAT done [production]
19:44 <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] fix cluster settings for temp clusters psi&omega (duration: 00m 44s) [production]
19:40 <moritzm> removed labvirt1014 from debmonitor DB, has been renamed to cloudvirt1014 [production]
19:39 <volans> imported python-elasticsearch_5.4.0-1~deb9u1 into apt.w.o stretch-wikimedia component/spicerack - T205884 [production]
19:35 <dcausse@deploy1001> Synchronized php-1.33.0-wmf.8/extensions/TwoColConflict/: T210501: Add missing code to not loose edits on the other side (duration: 00m 45s) [production]
19:29 <bblack> authdns2001: upgrading gdnsd to 2.99.9944-beta [production]
19:27 <bblack> multatuli: upgrading gdnsd to 2.99.9944-beta [production]
19:22 <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T211234: Enable Block notice stats on top blocking wikis (duration: 00m 45s) [production]
19:19 <bblack> authdns1001: upgrading gdnsd to 2.99.9944-beta [production]
18:52 <arlolra> Updated Parsoid to 4242ad0 (T204622, T211738) [production]
18:40 <arlolra@deploy1001> Finished deploy [parsoid/deploy@e27574c]: Updating Parsoid to 4242ad0 (duration: 09m 17s) [production]
18:31 <arlolra@deploy1001> Started deploy [parsoid/deploy@e27574c]: Updating Parsoid to 4242ad0 [production]
18:30 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@93443fe]: Refine MW API queries (duration: 03m 41s) [production]
18:26 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@93443fe]: Refine MW API queries [production]
18:24 <jforrester@deploy1001> Synchronized wmf-config/Wikibase.php: T204748 [Beta only] Use newly-fixed config for Wikibase->Commons federation (duration: 00m 44s) [production]
18:22 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T204748 Rename repo-only Wikibase config for clarity [no-op] (duration: 00m 45s) [production]