7001-7050 of 10000 results (70ms)
2018-05-07 §
07:19 <marostegui> Stop replication in sync on db1060 and db1074 - T193732 [production]
07:19 <moritzm> reimaging mw1303, mw1304 (job runners) to stretch [production]
07:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1074 - T193732 (duration: 00m 59s) [production]
07:06 <moritzm> reimaging mw1233, mw1234, mw1235 (API servers) to stretch [production]
07:02 <moritzm> reimaging mw1327, mw1328, mw1329 (app servers) to stretch [production]
05:37 <marostegui> Unused databases devwikiinternal and rel13testwiki from s3 - T118764 [production]
05:27 <marostegui> Deploy schema change on db1081 - T191519 T188299 T190148 [production]
05:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1081 for alter table (duration: 01m 01s) [production]
05:15 <marostegui> Deploy schema change on s6 primary master db1061 - T191519 T188299 T190148 [production]
03:06 <l10nupdate@tin> scap sync-l10n completed (1.32.0-wmf.2) (duration: 11m 22s) [production]
2018-05-05 §
03:36 <XioNoX> commenting rigel out from smokeping [production]
02:16 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2191.codfw.wmnet [production]
02:03 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2193.codfw.wmnet [production]
01:37 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2187.codfw.wmnet [production]
00:35 <Krinkle> Delete navtiming 'mediaWikiLoadComplete' metrics (T160315) [production]
00:26 <Krinkle> Purging values for navtiming 'mediaWikiLoadEnd' sub-properties from 2018-04-21 to 2018-05-04T04:40:00 (T160315) [production]
2018-05-04 §
22:50 <mutante> mwmaint1001 - now using mw-maintenance role, upcoming terbium replacement [production]
22:49 <mutante> mw2187 - scap proxy - reinstalling with stretch [production]
22:46 <mutante> mw2191, mw2193 - wmf-auto-reimage with --no-verify because puppet certs didnt exist [production]
22:02 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2199.codfw.wmnet [production]
22:00 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2198.codfw.wmnet [production]
21:55 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2197.codfw.wmnet [production]
19:50 <bblack> rebooting lvs1016 (downtimed, also new and not in service!) [production]
19:02 <sbisson@tin> Finished deploy [kartotherian/deploy@8e6b35b]: Use new keyspace (v4) for both i18n and non-i18n sources (duration: 03m 57s) [production]
18:58 <sbisson@tin> Started deploy [kartotherian/deploy@8e6b35b]: Use new keyspace (v4) for both i18n and non-i18n sources [production]
18:38 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2196.codfw.wmnet [production]
18:36 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2194.codfw.wmnet [production]
18:35 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2195.codfw.wmnet [production]
18:16 <mutante> mw2197,mw2198,mw2199 - reinstall with stretch [production]
18:12 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2192.codfw.wmnet [production]
18:05 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2190.codfw.wmnet [production]
18:03 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2189.codfw.wmnet [production]
17:16 <XioNoX> depolled eqsin [production]
16:57 <bawolff> adjusted login throttling code (T193762) [production]
16:50 <dzahn@neodymium> conftool action : set/pooled=inactive; selector: name=mw2196.codfw.wmnet [production]
16:50 <dzahn@neodymium> conftool action : set/pooled=inactive; selector: name=mw2194.codfw.wmnet [production]
16:50 <dzahn@neodymium> conftool action : set/pooled=inactive; selector: name=mw2195.codfw.wmnet [production]
16:50 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=mw2194.codfw.wmnet [production]
16:49 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=mw2196.codfw.wmnet [production]
16:25 <XioNoX> adding BGP graceful shutdown to routers - T190323 [production]
16:19 <bawolff> Logging adjustment in mediawiki for T193762 [production]
15:57 <arturo> enabled puppet in labcontrol1001, labnodepol100[1-2] and labtestvirt10[01-22] after patches deployed for T193657 [production]
15:16 <mutante> mw2194, mw2195, mw2196 - reinstall with stretch - mw2193 - puppet cert not found [production]
15:06 <arturo> disabling puppet in labnodepool100[1-2] for T193657 [production]
15:05 <arturo> disabling puppet in labcontrol1001 for T193657 [production]
14:52 <arturo> disabling puppet in labvirt10[01-22] to deploy https://gerrit.wikimedia.org/r/#/c/430581/ and https://gerrit.wikimedia.org/r/#/c/430614/ T193657 [production]
14:05 <mutante> mw2189, mw2190, mw2192 - reinstall with stretch, mw2191 - puppet cert not found [production]
13:33 <marostegui> Manually enable innodb_strict_mode on labsdb1009 - T150949 [production]
12:09 <hashar> restarted Jenkins on contint1001 (java update) [production]
12:04 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2081 (duration: 00m 59s) [production]