5901-5950 of 10000 results (85ms)
2019-04-05 §
07:34 <jijiki> Repooling thumbor1004 until we replace its memory - T215411 [production]
07:18 <moritzm> upgrading mw1262-mw1265 to HHVM 3.18.5+dfsg-1+wmf8+deb9u2 and wikidiff 1.8.1 (T203069) [production]
06:56 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1075 (duration: 00m 57s) [production]
06:04 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1075 (duration: 01m 00s) [production]
05:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1075 with low weight (duration: 00m 58s) [production]
05:15 <marostegui> Fully upgrade and reboot db1075 [production]
05:14 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1075 (duration: 00m 59s) [production]
04:49 <gilles> T216594 Start purge of namespace 0 on ruwiki [production]
02:27 <eileen> update civicrm revision changed from 7560af93df to 3c55850631, config revision is 9ad5ef3e15 [production]
00:09 <bd808@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:497866|wikitech: Lock LDAP accounts when users are blocked]], [[gerrit:501123|Disable Phabricator accounts when blocked on wikitech]] (T168692) 2/2 (duration: 00m 57s) [production]
00:07 <bd808@deploy1001> Synchronized wmf-config/wikitech.php: SWAT: [[gerrit:497866|wikitech: Lock LDAP accounts when users are blocked]], [[gerrit:501123|Disable Phabricator accounts when blocked on wikitech]] (T168692) (duration: 00m 59s) [production]
2019-04-04 §
23:52 <bd808@deploy1001> Synchronized php-1.33.0-wmf.23/extensions/LdapAuthentication: SWAT: [[gerrit:501412|Also set an LDAP password policy on Block]] (T168692) (duration: 01m 01s) [production]
23:38 <bd808@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:501393|Add smn and sms to wmgExtraLanguageNames]] (T220118) (duration: 01m 02s) [production]
21:22 <XioNoX> renumber AS58587 to AS10075 in eqsin [production]
21:17 <bblack> DNS deploying https://gerrit.wikimedia.org/r/c/operations/dns/+/500731 which can affect resolution of our CNAME records. If dns-related issues, can revert at will! [production]
21:09 <herron> restarting eqiad ELK stack for security updates [production]
20:45 <marxarelli> promotion of 1.33.0-wmf.24 rolled back to group0 and holding. cc: T206678, T220037 [production]
20:41 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: Revert "group2/group1 wikis to 1.33.0-wmf.24" [production]
20:36 <marxarelli> rolling back again following still high rates of DBTransactionError (avg ~ 800/min) [production]
20:16 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.24 [production]
20:11 <marxarelli> promoting 1.33.0-wmf.24 to all wikis [production]
20:11 <marxarelli> error rates look good after proper syncs and re-deploy. cc: T220037 [production]
20:06 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/Citoid/modules/ve.ui.Citoid.init.js: sync for https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Citoid/+/501114 (duration: 00m 58s) [production]
20:04 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/LdapAuthentication/LdapAuthenticationPlugin.php: sync for https://gerrit.wikimedia.org/r/c/mediawiki/extensions/LdapAuthentication/+/500994 (duration: 00m 57s) [production]
20:03 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/LdapAuthentication/LdapAuthenticationHooks.php: sync for https://gerrit.wikimedia.org/r/c/mediawiki/extensions/LdapAuthentication/+/500994 (duration: 00m 58s) [production]
20:02 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/LdapAuthentication/LdapAuthentication.php: sync for https://gerrit.wikimedia.org/r/c/mediawiki/extensions/LdapAuthentication/+/500994 (duration: 00m 58s) [production]
19:58 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/EventBus/includes/JobExecutor.php: syncing JobExecutor changes (duration: 00m 58s) [production]
19:55 <dduvall@deploy1001> Synchronized php: group1 wikis to 1.33.0-wmf.24 (duration: 01m 47s) [production]
19:53 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.24 [production]
19:51 <marxarelli> re-deploying to group1 after proper syncs [production]
19:47 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/Citoid/modules/ve.ui.Citoid.init.js: (no justification provided) (duration: 00m 59s) [production]
19:46 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/EventBus/includes/JobExecutor.php: (no justification provided) (duration: 00m 58s) [production]
19:45 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/LdapAuthentication/LdapAuthenticationPlugin.php: (no justification provided) (duration: 00m 58s) [production]
19:44 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/LdapAuthentication/LdapAuthenticationHooks.php: (no justification provided) (duration: 00m 59s) [production]
19:43 <dduvall@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/LdapAuthentication/LdapAuthentication.php: (no justification provided) (duration: 00m 59s) [production]
19:19 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: Revert "group1 wikis to 1.33.0-wmf.24" [production]
19:13 <marxarelli> large spike in DBTransactionError errors. rolling back. cc: T220037 [production]
19:12 <dduvall@deploy1001> Synchronized php: group1 wikis to 1.33.0-wmf.24 (duration: 01m 46s) [production]
19:10 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.24 [production]
19:06 <marxarelli> fetch/rebase looks good, incorporates fixes for T220037, T219510. deploying [production]
19:03 <marxarelli> preparing to promote 1.33.0-wmf.24 to group1 [production]
18:33 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable partial blocks on frwiki, plwiki (T219327, T219218) (duration: 00m 58s) [production]
18:23 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable ORES RCFilters on eswikiquote (T219160) (duration: 01m 02s) [production]
18:13 <moritzm> restarted apache on people.wikimedia.org to pick up OpenSSL update [production]
17:59 <bstorm_> stopped postgresql on labsdb1006.eqiad.wmnet and moved the database master functionality (and all rsyncs) to clouddb1003.clouddb-services.eqiad.wmflabs [production]
17:59 <ppchelko@deploy1001> Finished deploy [cpjobqueue/deploy@922cbc0]: Switch to new logging infrastructure T211125 (duration: 04m 03s) [production]
17:55 <ppchelko@deploy1001> Started deploy [cpjobqueue/deploy@922cbc0]: Switch to new logging infrastructure T211125 [production]
17:47 <ppchelko@deploy1001> Finished deploy [changeprop/deploy@f69dc9c]: Switch to new logging infrastructure T211125 (duration: 01m 44s) [production]
17:45 <ppchelko@deploy1001> Started deploy [changeprop/deploy@f69dc9c]: Switch to new logging infrastructure T211125 [production]
17:33 <jynus> stopping replication on dbstore2001:s8 for backup testing T206203 [production]