4901-4950 of 10000 results (64ms)
2018-02-26 §
15:43 <cmjohnson1> swapping failed disk db1068 [production]
15:42 <andrewbogott> marking wikitech read-only (via a local edit to CommonSettings.php) for https://phabricator.wikimedia.org/T188029 [production]
15:41 <andrewbogott> marking wikitech read-only (via a local edit to CommonSettings.php) for https://phabricator.wikimedia.org/T188029 [production]
15:32 <addshore> EU SWAT done [production]
15:31 <addshore@tin> Finished scap: Updated mediawiki/extensions/AdvancedSearch i18n files for some translations (duration: 11m 29s) [production]
15:19 <addshore@tin> Started scap: Updated mediawiki/extensions/AdvancedSearch i18n files for some translations [production]
15:12 <Amir1> This might have performance implications roll it back if it affects these wikis too much [production]
15:12 <gehel> reboot of relforge completed, cluster is green again [production]
15:11 <ladsgroup@tin> Synchronized wmf-config/Wikibase-production.php: [[gerrit:414667|Enable reading full entity id from wb_terms table in three wikis (T114903)]] (duration: 00m 56s) [production]
14:54 <ladsgroup@tin> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:414650|Add patrol rights/groups to fawikisource (T187662)]] (duration: 00m 56s) [production]
14:52 <gehel> rebooting relforge for kernel upgrade [production]
14:50 <godog> upload puppetdb 4.4.0-1~wmf1 to stretch-wikimedia - T177253 [production]
14:48 <ladsgroup@tin> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:V|Enable statement usage tracking in several wikis (T151717)]] (duration: 00m 57s) [production]
14:40 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:407901|Add namespaces to urwiktionary (T186393)]] (duration: 00m 56s) [production]
14:28 <zfilipin@tin> Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:413724|Enable caching of constraint check results (T184812)]] (duration: 00m 55s) [production]
14:15 <moritzm> rebooting scb in codfw for kernel security updates [production]
14:10 <zfilipin@tin> Synchronized php-1.31.0-wmf.22/extensions/UniversalLanguageSelector/maintenance/ULSCompactLinksDisablePref.php: SWAT: [[gerrit:414609|Added option to continue script from particular User ID]] [[gerrit:414608|Use a replica dedicated to slow queries (if available) (T187880)]] (duration: 00m 58s) [production]
13:09 <moritzm> rebooting video scalers in eqiad for kernel security update [production]
11:12 <jdrewniak@tin> Synchronized portals: Wikimedia Portals Update: [[gerrit:402805|Bumping portals to master (T128546)]] (duration: 00m 57s) [production]
11:11 <jdrewniak@tin> Synchronized portals/prod/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:402805|Bumping portals to master (T128546)]] (duration: 00m 58s) [production]
11:01 <moritzm> powercycling mw1264 (stuck after reboot) [production]
10:10 <moritzm> rebooting mw canaries for kernel security update [production]
09:29 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2055 and db2070 (duration: 00m 55s) [production]
09:23 <elukey> copied burrow 0.1 from jessie-wikimedia to stretch-wikimedia [production]
08:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1103:3314 (duration: 00m 56s) [production]
08:10 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 (duration: 00m 56s) [production]
07:51 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic db1103:3314 (duration: 00m 56s) [production]
07:36 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic db1103:3314 (duration: 00m 56s) [production]
07:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1103:3314 after mariadb and kernel upgrade (duration: 00m 56s) [production]
07:08 <marostegui> Deploy schema change on db1103:3312 - T187089 T185128 T153182 [production]
06:59 <marostegui> Stop MySQL on db1103:3312 and 3314 to upgrade it and kernel [production]
06:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 (duration: 00m 54s) [production]
06:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 (duration: 00m 56s) [production]
06:35 <marostegui> Stop MySQL db2070 and db2055 to copy data to db2055 (and upgrade kernel and mariadb) [production]
06:35 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2055 and db2070 (duration: 01m 07s) [production]
06:15 <marostegui> Stop MySQL on db1115 tendril database to copy it to db2093. Tendril (dbtree) service will be down for maintenance - T184704 [production]
02:55 <XioNoX> labs->cloud vlan rename in codfw - T187933 [production]
02:43 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.22) (duration: 07m 12s) [production]
02:15 <XioNoX> disabling ALGs on MR routers [production]
2018-02-25 §
07:35 <marostegui> Fix s7 replication on labsdb1010 - T186579 [production]
2018-02-24 §
06:11 <marostegui> Reload haproxy on dbproxy1005 [production]
01:42 <demon@tin> Synchronized docroot/noc/conf/highlight.php: one last time (duration: 00m 57s) [production]
01:18 <demon@tin> Synchronized docroot/noc/conf/index.php: fix dblist links from listing (duration: 00m 56s) [production]
01:13 <Reedy> added eqsin ipv6 range to botpasswords ip range restriction T188111 [production]
01:08 <demon@tin> Synchronized docroot/noc/: dblists cleanup (duration: 00m 57s) [production]
01:07 <demon@tin> Synchronized tests/: no-op (duration: 00m 59s) [production]
2018-02-23 §
22:36 <demon@tin> Finished deploy [gerrit/gerrit@010ad50]: no-op, removing permission from file (duration: 00m 10s) [production]
22:35 <demon@tin> Started deploy [gerrit/gerrit@010ad50]: no-op, removing permission from file [production]
21:27 <demon@tin> Finished scap: pos mysql code (duration: 23m 09s) [production]
21:04 <demon@tin> Started scap: pos mysql code [production]