1-50 of 10000 results (27ms)
2016-03-28 §
23:38 <maxsem@tin> Synchronized php-1.27.0-wmf.18/includes/api/ApiUpload.php: https://gerrit.wikimedia.org/r/#/c/280092/ (duration: 02m 26s) [production]
23:34 <mutante> mw2090 - reboot, reinstall as regular appserver [production]
23:27 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/280115/ (duration: 00m 35s) [production]
23:18 <maxsem@tin> Synchronized php-1.27.0-wmf.18/extensions/Echo/: https://gerrit.wikimedia.org/r/#/c/280112/ (duration: 00m 43s) [production]
23:16 <maxsem@tin> Synchronized php-1.27.0-wmf.18/extensions/MobileApp/: https://gerrit.wikimedia.org/r/#q,279980,n,z (duration: 01m 07s) [production]
22:03 <mutante> mw2090 - disable puppet/cron, crons now on wasat [production]
21:46 <mutante> mw1119 restarted hhvm [production]
21:26 <bblack> http/2 enabled on pinkunicorn.wikimedia.org for testing - T96848 [production]
21:26 <bblack> http/2 enabled on pinkunicorn.wikimedia.org for testing [production]
21:12 <Pchelolo> restbase finised deploy of 78e6eab37c [production]
21:04 <Pchelolo> restbase start deploy of 78e6eab37c [production]
21:04 <mdholloway> mobileapps deployed 90cfdcd [production]
20:37 <Pchelolo> restbase canary deploy of 78e6eab37c to restbase1005 [production]
20:35 <mdholloway> starting mobileapps deployment [production]
18:30 <andrewbogott> labs public DNS will remain in a transitional state until MarkMonitor updates their records and the TTL expires. DNS resolution should proceed as usual in the meantime. [production]
18:03 <mutante> mw1140 restart hhvm [production]
17:52 <cmjohnson1> shutting down radon to re-apply thermal paste: [production]
17:45 <mutante> mw1152,mw2090,terbium apt-get remove python-mysqldb (T84075) [production]
17:44 <legoktm> manually fixed T129881 rename [production]
17:20 <paravoid> cr1/2-eqiad: deactivating static routes for ns0/ns1 (ipv4/ipv6) pointing to radon [production]
17:18 <bblack> rebooting radon again [production]
15:31 <thcipriani@tin> Synchronized php-1.27.0-wmf.18/extensions/OpenStackManager/OpenStackManager.php: SWAT: Wikitech: Remove address, domain, proxy special pages [[gerrit:279569]] (duration: 00m 31s) [production]
13:32 <bblack> rebooting radon (unresponsive console) [production]
08:44 <paravoid> force-rebooting ms-be2008 to fix hundreds of unkillable mkfs.xfs stuck due to a hosed disk [production]
08:21 <paravoid> powercycling ms-be2016, down for ~1d, unresponsive on console [production]
02:35 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Mar 28 02:35:00 UTC 2016 (duration 8m 26s) [production]
02:26 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 11m 32s) [production]
2016-03-27 §
22:21 <ori@tin> Synchronized wmf-config/StartProfiler.php: I1b5c620b85: Better request profiling via XWD header (duration: 00m 33s) [production]
20:11 <elukey> restarted hhvm on mw1123 [production]
20:04 <elukey> Increased nf_conntrack_max to ~528k for the kafka brokers (https://gerrit.wikimedia.org/r/279776) [production]
02:57 <jzerebecki> disabling 2fa for Dereckson T130892 [labswiki]> delete from oathauth_users where id=402; [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Mar 27 02:31:03 UTC 2016 (duration 8m 35s) [production]
02:22 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 10m 06s) [production]
01:51 <jzerebecki> disabling 2fa for Hym411 T130994 [labswiki]> delete from oathauth_users where id=1363; [production]
2016-03-26 §
21:11 <csteipp_ooo> removed 2FA from wikitech accounts that looked to be affected by T130892 [production]
16:21 <krenair@tin> Synchronized php-1.27.0-wmf.18/extensions/SemanticForms: https://gerrit.wikimedia.org/r/#/c/279701/ (duration: 00m 32s) [production]
13:46 <urandom> Cassandra on restbase2004.codfw.wmnet shut down, hardware failure; Down for the weekend : T130990 [production]
13:26 <urandom> Stopping Cassandra on restbase2004.codfw.wmnet [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Mar 26 02:31:13 UTC 2016 (duration 8m 34s) [production]
02:22 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 10m 06s) [production]
00:11 <mutante|away> scb[12]00[12] - delete changeprop main.log per request [production]
2016-03-25 §
21:52 <ori> Updated Grafana to latest nightly [production]
21:19 <ori@tin> Synchronized wmf-config/logging.php: Ibc96f9d3bd: Integrate X-Wikimedia-Debug with Logstash; I28b137f5e035: Logging: convert to short array syntax (duration: 00m 36s) [production]
20:46 <ori@tin> Synchronized php-1.27.0-wmf.18/includes/filerepo/LocalRepo.php: Idaa1237638: Request-local caching of image_redirect and I545ce6b160b: Lower pcTTL in checkRedirect() to 30 (duration: 00m 37s) [production]
19:31 <tgr> running extensions/CentralAuth/maintenance/checkLocal{Names,User}.php on jawiktionary and dewikiquote [production]
19:08 <mutante> scb1001 - Unit changeprop.service entered failed state - it's a new deployment though, acked earlier by mobrovac already [production]
18:27 <mobrovac> restbase started mobile-sections dump of enwiki on restbase1009 for articles edited before 2016-03-23 as per T130698 [production]
17:19 <akosiaris> rolling restart of restbase nodes to apply https://gerrit.wikimedia.org/r/#/c/279597/ [production]
16:55 <ori@tin> Synchronized wmf-config/logging.php: Ia2cd5daaf3: Update logging config for request IDs (duration: 00m 31s) [production]
16:50 <ori@tin> Synchronized php-1.27.0-wmf.18/includes: Iaf90c20c330e: Provide a unique request identifier (duration: 01m 22s) [production]