|
2021-04-22
§
|
| 13:23 |
<marostegui> |
Tendril and dbtree are up but on a degraded status (slow reponse) |
[production] |
| 13:19 |
<marostegui> |
Tendril and dbtree are down at the moment |
[production] |
| 12:46 |
<Urbanecm> |
Start server-side upload for 2 video files (T280763, T280524) |
[production] |
| 12:31 |
<marostegui> |
Restart mysql on db1115 (tendril/dbtree will fail) |
[production] |
| 08:44 |
<Krenair> |
Removed yuvipanda from roots sudo policy |
[tools] |
| 08:42 |
<Krenair> |
Removed yuvipanda from projectadmin per request |
[tools] |
| 08:40 |
<Krenair> |
Removed yuvipanda from tools.admin per request |
[tools] |
| 06:06 |
<legoktm> |
reloading zuul to deploy https://gerrit.wikimedia.org/r/680697 |
[releng] |
| 04:55 |
<eileen> |
civicrm revision changed from 42ca3cf65a to 33a63d5789, config revision is cf07e7ba0b |
[production] |
| 02:53 |
<Reedy> |
killed a few stuck beta ci jobs |
[releng] |
| 02:51 |
<Krinkle> |
The 'beta-mediawiki-config-update-eqiad' jobs have been stuck for ~ 8 hours |
[releng] |
| 02:47 |
<krinkle@deploy1002> |
Finished deploy [integration/docroot@010e445]: (no justification provided) (duration: 00m 09s) |
[production] |
| 02:47 |
<krinkle@deploy1002> |
Started deploy [integration/docroot@010e445]: (no justification provided) |
[production] |
| 02:19 |
<James_F> |
Zuul: Switch bundle-yard-publish jobs to Ruby 2.5 T280874 |
[releng] |
| 01:49 |
<James_F> |
Zuul: [mediawiki/vagrant] Add mediawiki-vagrant-ruby2.5-rake-docker as experimental T280874 |
[releng] |
| 01:44 |
<James_F> |
Docker: Publishing rake-vagrant-ruby2.5:0.1.0 for T280874 |
[releng] |
| 01:34 |
<eileen> |
civicrm revision changed from 35a8dd33ba to 42ca3cf65a, config revision is cf07e7ba0b |
[production] |
| 00:45 |
<James_F> |
Zuul: Add experimental Ruby 2.5 jobs for two repos T280874 |
[releng] |
| 00:28 |
<legoktm> |
legoktm@deneb:/var/cache/pbuilder/aptcache$ sudo rm -rf * # Cleaned up 8GB more |
[production] |
| 00:27 |
<legoktm> |
legoktm@deneb:/var/cache/apt/archives$ sudo rm -rf * # cleaned up 6GB |
[production] |
| 00:03 |
<legoktm> |
subscribed all list admins to the listadmins@ mailing list (T280716) |
[production] |
|
2021-04-21
§
|
| 23:58 |
<eileen> |
tools revision changed from 3d950fffbd to c26a8c0cb6 |
[production] |
| 23:49 |
<legoktm> |
made myself and Amir1 list admins for the listadmins@lists.wikimedia.org mailing list |
[production] |
| 23:43 |
<James_F> |
Zuul: [operations/puppet-lint/wmf_styleguide-check] Switch to Ruby 2.5 |
[releng] |
| 23:25 |
<James_F> |
Zuul: Provide experimental Ruby 2.5 rake jobs T280874 |
[releng] |
| 22:56 |
<James_F> |
Zuul: Add mwgate-ruby2.5-rake-docker experimentally to mwgate-rake |
[releng] |
| 22:36 |
<James_F> |
Docker: Publishing rake-ruby2.5:0.1.0 for T280874 |
[releng] |
| 21:30 |
<ottomata> |
temporariliy disabling sanitize_eventlogging_analytics_delayed jobs until T280813 is completed (probably tomorrow) |
[analytics] |
| 20:32 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudcephosd1017.eqiad.wmnet |
[production] |
| 20:21 |
<robh@cumin1001> |
START - Cookbook sre.hosts.decommission for hosts cloudcephosd1017.eqiad.wmnet |
[production] |
| 20:18 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudcephosd1016.eqiad.wmnet |
[production] |
| 20:04 |
<ottomata> |
renaming event_santized hive table directories to lower case and repairing table partition paths - T280813 |
[analytics] |
| 20:03 |
<robh@cumin1001> |
START - Cookbook sre.hosts.decommission for hosts cloudcephosd1016.eqiad.wmnet |
[production] |
| 19:59 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host planet1003.eqiad.wmnet |
[production] |
| 19:52 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 19:48 |
<robh@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 19:48 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 19:46 |
<mutante> |
creating a ganeti VM to test bullseye install |
[production] |
| 19:46 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm for new host planet1003.eqiad.wmnet |
[production] |
| 19:45 |
<bstorm> |
manually kicking off a run of update-openstack-mirror on sodium to capture an upstream package update |
[production] |
| 19:15 |
<robh@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 18:47 |
<James_F> |
Add ImageMap to the list of Parsoid's ext dependencies |
[releng] |
| 18:46 |
<Urbanecm> |
Morning B&C done |
[production] |
| 18:42 |
<urbanecm@deploy1002> |
Synchronized php-1.37.0-wmf.1/extensions/WikibaseMediaInfo/: f831d16e42e712832d683233a5b21ad59f7c73b3: Make the logistic regression image search default (T271799) (duration: 00m 58s) |
[production] |
| 18:38 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: f6d076a69607172475a86ba935a273e7519108d1: Update $wgGEHomepageNewAccountVariants (T278123) (duration: 00m 58s) |
[production] |
| 18:14 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 1ae5ca5467fad7bfdae8aa94b241fe6c048ab8e5: Set wgGEMentorshipMigrationStage to WRITE_BOTH/READ_NEW everywhere (T279853) (duration: 00m 59s) |
[production] |
| 18:05 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: e252de0482c60e87e06d866006bb9ceb186af6cf: eswiki: Push Growth features out of dark mode (T278235) (duration: 01m 00s) |
[production] |
| 17:59 |
<dcaro> |
all monitors upgraded on codfw1 with one cookbook `cookbook --verbose -c ~/.config/spicerack/cookbook.yaml wmcs.ceph.upgrade_mons --monitor-node-fqdn cloudcephmon2002-dev.codfw.wmnet` (T280641) |
[admin] |
| 17:47 |
<dcaro> |
upgrading monitors and mrg nodes on codfw ceph cluster (T280641) |
[admin] |
| 17:43 |
<jynus> |
deploy grant changes on m5 backup sources (db1117 and db2078) T278614 |
[production] |