701-750 of 10000 results (39ms)
2017-10-16 §
12:59 <gehel> restart cassandra on maps1001 [production]
12:38 <ema> upgrading eqiad LVSs to pybal 1.14.2 (T178149, T177815) [production]
11:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1074 - T174509 (duration: 00m 46s) [production]
11:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1070 - T174509 (duration: 00m 46s) [production]
11:10 <mobrovac@tin> Started restart [electron-render/deploy@8dd5f13]: Electron hanging - T174916 [production]
10:48 <Amir1> cleaning up ores_classification table in wikidatawiki (T159753) [production]
10:03 <ema> upgrading codfw LVSs to pybal 1.14.2 (T178149, T177815) [production]
09:54 <ema> upgrading esams LVSs to pybal 1.14.2 (T178149, T177815) [production]
09:44 <ema> upgrading ulsfo LVSs to pybal 1.14.2 (T178149, T177815) [production]
09:43 <ema> pybal 1.14.2 uploaded to apt.w.o [production]
09:40 <moritzm> restarting cassandra on restbase1007 to pick up NSS security update [production]
09:39 <moritzm> restarting cassandra on cerium/xenon/praseodymium to pick up NSS security update [production]
09:37 <gehel> restarting elasticsearch on elastic1017 [production]
09:10 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1088 - T174509 T177772 (duration: 00m 46s) [production]
09:07 <marostegui> Optimize recentchanges, pagelinks and templatelinks on db1088 - https://phabricator.wikimedia.org/T174509 https://phabricator.wikimedia.org/T177772 [production]
09:02 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1093 - T174509 T177772 (duration: 00m 46s) [production]
08:53 <marostegui> Stop MySQL on db1050 as it will be decommissioned - T178162 [production]
08:46 <marostegui> Remove db1050 from tendril - T178162 [production]
08:46 <marostegui> Remove db1050 from tendril - 178162 [production]
08:31 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Remove db1050 from config - T178162 (duration: 00m 46s) [production]
08:30 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db1050 from config - T178162 (duration: 00m 46s) [production]
07:56 <marostegui> Stop db1103 and db1038 at the same position to fix data drifts - T164488 [production]
07:42 <moritzm> installing NSS security updates [production]
07:30 <marostegui> Stop db1103 and db1072 at the same position to fix data drifts - T164488 [production]
07:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1072 - T164488 (duration: 00m 46s) [production]
07:19 <marostegui> Optimize table ores_classification on db1073 - T159753 [production]
07:14 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Add db2084 to the config - T170662 (duration: 00m 46s) [production]
07:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add db2084 to the config - T170662 (duration: 00m 47s) [production]
06:25 <marostegui> Stop MySQL on db2079 to clone db2084 from it - T170662 [production]
06:12 <marostegui> Optimize pagelinks and templatelinks on db1094 - T174509 [production]
06:04 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1093 - T174509 T177772 (duration: 00m 46s) [production]
06:04 <marostegui> Optimize recentchanges, pagelinks and templatelinks on db1093 - T174509 T177772 [production]
06:00 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1070 - T174509 (duration: 00m 46s) [production]
05:59 <marostegui> Optimize recentchanges, pagelinks and templatelinks on db1070 - T174509 [production]
05:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1084 - T174509 T177772 (duration: 00m 46s) [production]
05:53 <marostegui> Optimize recentchanges, pagelinks and templatelinks on db1084 - T174509 T177772 [production]
05:47 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1074 - T174509 (duration: 00m 46s) [production]
05:47 <marostegui> Optimize pagelinks and templatelinks on db1074 - T174509 [production]
05:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1073 - T174509 (duration: 00m 47s) [production]
05:37 <marostegui> Optimize templatelinks and pagelinks on db1073 - T174509 [production]
05:36 <marostegui> Optimize templatelinks and pagelinks on db1073 - 174509 [production]
02:35 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Oct 16 02:35:34 UTC 2017 (duration 6m 36s) [production]
02:28 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.3) (duration: 07m 44s) [production]
2017-10-15 §
11:15 <mobrovac@tin> Started restart [electron-render/deploy@8dd5f13]: Electron hanging - T174916 [production]
2017-10-14 §
03:52 <paravoid> manually cleaning up pdns_metric_cron from all dnsrecursors (hydrogen/chromium/acamar/achernar/maerlant/nescio) [production]
2017-10-13 §
23:04 <mutante> scb1001 - systemctl restart pdfrender (Icinga said: pdfrender Connection refused) [production]
20:36 <mutante> gerrit2001 - removing hhvm package (which is now possible without also removing scap, thanks thcipriani), apt-get autoremove to remove more unused packages (T178039) [production]
18:52 <joal@tin> Finished deploy [analytics/aqs/deploy@0375c34]: Deploy new mediawiki-history endpoints-alpha version (duration: 15m 02s) [production]
18:40 <joal@tin> (no justification provided) [production]
18:37 <joal@tin> Started deploy [analytics/aqs/deploy@0375c34]: Deploy new mediawiki-history endpoints-alpha version [production]