9001-9050 of 10000 results (46ms)
2013-11-12 §
23:31 <Ryan_Lane> upgrading wikitech-static to 1.23wmf3 [production]
23:20 <^d> gitblit process had hung on antimony, restarted [production]
23:17 <Ryan_Lane> upgrading wikitech to 1.23wmf3 [production]
23:10 <maxsem> Started syncing Wikimedia installation... : Demo deployment, no actual changes [production]
22:59 <maxsem> synchronized wmf-config 'https://gerrit.wikimedia.org/r/94404' [production]
22:55 <maxsem> synchronized wmf-config 'https://gerrit.wikimedia.org/r/#/c/93988/' [production]
22:50 <maxsem> synchronized php-1.23wmf3/extensions/MobileFrontend/ 'Fix fatal' [production]
22:47 <maxsem> synchronized php-1.23wmf2/extensions/MobileFrontend/ 'Fix fatal' [production]
21:57 <cmjohnson1> dns update [production]
21:34 <aaron> cleared profiling data [production]
21:21 <aaron> synchronized php-1.23wmf3/maintenance/cleanupUploadStash.php '6461a943ece41ac6914fc60ec16854f0591f0f2b' [production]
21:04 <Reedy> Profiling data clearing seems to work, but echo "-truncate" | nc -q0 -u professor.pmtpa.wmnet 3811 doesn't return... [production]
21:02 <reedy> synchronized wmf-config/ [production]
20:28 <andrewbogott> deployed new AbortNewAccount hook on wikitech [production]
20:14 <reedy> cleared profiling data [production]
20:03 <reedy> cleared profiling data [production]
19:55 <reedy> synchronized wmf-config/InitialiseSettings.php 'Iab47779a2c0f9fe239676d75a279336156353c4b' [production]
19:48 <reedy> updated /a/common to {{Gerrit|I1bb030fce}}: Enable mwsearch logs [production]
19:44 <reedy> synchronized php-1.23wmf2 'Support CIDR ranges in $wgSquidServersNoPurge' [production]
19:40 <reedy> synchronized php-1.23wmf3 'Support CIDR ranges in $wgSquidServersNoPurge' [production]
19:18 <Reedy> Created EducationProgram tables on elwiki bug 56771 [production]
18:01 <mark> Rebooting amssq60, stuck in xfs kmem_alloc deadlock [production]
17:55 <reedy> synchronized php-1.23wmf3/extensions/MWSearch/ [production]
17:54 <reedy> synchronized php-1.23wmf2/extensions/MWSearch/ [production]
17:38 <reedy> updated /a/common to {{Gerrit|I4baa719b9}}: CirrusSearch as secondary for nlwiki [production]
17:38 <reedy> synchronized wmf-config/InitialiseSettings.php 'Enable mwsearch logs' [production]
17:09 <manybubbles> synchronized wmf-config/InitialiseSettings.php 'Enable Cirrus as secondary on nlwiki' [production]
16:30 <cmjohnson1> swapping ps1-c7-eqiad...one side at a time...notifications pending [production]
14:17 <springle> paused externallinks OSC jobs after replication glitch on dewiki. original table and data remain untouched [production]
11:33 <mark> Manually set dirty_background_ratio to 5 (from 10) on amssq58 [production]
11:30 <hashar> synchronized wmf-config/InitialiseSettings.php 'thottle rule for WikiCon {{gerrit|94860}}' [production]
11:30 <hashar> synchronized wmf-config/throttle.php 'thottle rule for WikiCon {{gerrit|94860}}' [production]
09:45 <mark> rebooting amssq58 with sysrq-trigger [production]
07:02 <springle> synchronized wmf-config/db-eqiad.php 'recache jobs on S2 to db1018' [production]
03:34 <springle> synchronized wmf-config/db-eqiad.php 'slave balancing' [production]
03:12 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Nov 12 03:12:05 UTC 2013 [production]
02:20 <LocalisationUpdate> completed (1.23wmf2) at Tue Nov 12 02:20:54 UTC 2013 [production]
02:15 <LocalisationUpdate> completed (1.23wmf3) at Tue Nov 12 02:15:03 UTC 2013 [production]
01:27 <springle> restart db1050 mariadb after outage, let repl catch up. new lvm snaps mount ok. leave out of pool for now [production]
2013-11-11 §
21:32 <paravoid> rebooting ms-be1003, kernel bug, system CPU & I/O wait through the roof [production]
20:08 <Nemo_bis> network level of bits application servers eqiad is back to the pre-deploy 18+8 MB/s [production]
19:56 <reedy> synchronized php-1.23wmf3/extensions/Wikibase 'https://gerrit.wikimedia.org/r/94790' [production]
19:41 <Reedy> Switching 588 wikis to 1.23wmf3 in one go seems to have upset the bits appserver pool [production]
19:26 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.23wmf3 [production]
19:23 <reedy> updated /a/common to {{Gerrit|Ibab846000}}: Bump wmgMemoryLimit to 210MB [production]
17:40 <reedy> synchronized php-1.23wmf3/extensions/FlaggedRevs 'https://gerrit.wikimedia.org/r/94774' [production]
16:22 <reedy> synchronized wmf-config/InitialiseSettings.php 'Bump wmgMemoryLimit to 210MB' [production]
16:21 <pp-pdf1> restarted all services [production]
16:20 <pp-pdf1> - upgrade mwlib to 0.15.12 [production]
16:13 <paravoid> upgrading image/video scalers [production]