Editor: Update the WordPress packages to the latest versions for 6.5

[youknowriad]

This ticket tracks updates to @wordpress npm packages for 6.5 release.

Trac ticket: https://core.trac.wordpress.org/ticket/60315

This PR is going to represent the initial packages update commit for 6.5 to bring all the latest updates from the Gutenberg repository. We will most likely discover shortcomings or requirements that need to be backported within this PR or prior to this PR.

Requirements

• [ ] The interactivity package and the view scripts need to be built and registered as ES modules.
• [ ] The navigation block uses an external class that needs to be moved to the block-library package. In progress here ​https://github.com/WordPress/gutenberg/pull/57979
• [ ] The preferences package has a dedicate style handle that need to be registered properly

Hey @luisherranz When update the packages, I was forced to update the build config for the Interactivity API related code because these are meant to be esmodules now. I made some incomplete tweaks so far.

• For example, I don't see the src/wp-includes/blocks/*/view.js files for some reason
• I'm guessing we also need to add some php code to the script loader of WordPress to "auto register" the modules (the view scripts and the interactivity package so far).
• Also, I added a new webpack config file to core that is specific to the packages that are written as modules, I'm assuming the interactivity package is just the first one and probably not the last

I'll take a look. Thanks, @youknowriad!

This is a preliminary fix to bundle and register the new Interactivity API modules: ​https://github.com/WordPress/wordpress-develop/commit/8a06712e29803926237504c814637074f90d32fc

• It contains a new file called interactivity-api.php which should be removed once the backport for the WP_Interactivity_API class lands. I'll remove it in the backport itself.
  • ​https://github.com/WordPress/gutenberg/pull/58066
• It contains some extra hardcoded code in the Webpack files due to the fact that the build-module output of the Interactivity API packages still contains React's JSX pragma instead of Preact's. @sirreal is working on that.
• The @wordpress/interactivity-router package is not working yet. I'll look into it and I'll report back.

• It contains some extra hardcoded code in the Webpack files due to the fact that the build-module output of the Interactivity API packages still contains React's JSX pragma instead of Preact's. @sirreal is working on that.

PR with short-term fix is here: ​https://github.com/WordPress/gutenberg/pull/58258

• The @wordpress/interactivity-router package is not working yet. I'll look into it and I'll report back.

​https://github.com/WordPress/wordpress-develop/commit/5c8c5afbed97e4e1dbd37de0b0f30f3bd3609545 solves the problem with the router, but this fix needs to wait until this PR is committed because without the caniuselite package update, Webpack refuses to bundle:

• ​https://github.com/WordPress/wordpress-develop/pull/5939

It also uncovered a bug when @wordpress/interactivity-router is imported statically that we will solve in Gutenberg.

Anyone know why the phpunit are failing on some php versions? Did we use some unsupported syntax or something? I'm having hard time reading the job jobs.

Anyone know why the phpunit are failing on some php versions? Did we use some unsupported syntax or something? I'm having hard time reading the job jobs.

It looks like some of the jobs are hitting the 20 minute timeout limit and getting abandoned.

​https://github.com/WordPress/wordpress-develop/blob/cc645160ab91289af4ebc036956be71a582d8595/.github/workflows/phpunit-tests-run.yml#L79

@youknowriad Maybe try bumping the value on this branch to 30 minutes to see if it helps. It shouldn't but me know if it causes issues running the workflows.

@peterwilsoncc I increased the timeout to 30mn and still seeing similar issues at roughly the same moment (20mn)

@costdev I think most of these changes need to be part of a follow-up because these files are copied as is from Gutenberg so I can't make the changes here. So this would require a follow-up package update. That said, I'm going to try to ping the right people responsible for each of these changes in order to make the changes upstream.

@ockham @tjcafferkey Are you able to take a look at the review comments regarding Navigation block (ref: ​https://github.com/WordPress/gutenberg/pull/57754/)?

With the increased timeout, the tests are starting to pass. Here's my suggested plan:

Given that this PR is kind of mandatory for 6.5 and a requirements for other backports to land, we need to try and land it quickly to prevent any potential delays in Beta1 later. So I suggest that we merge the PR with the timeout increase in the tests given that the performance tests don't show any regression in terms of real user WordPress performance.

That said, it's still concerning to me that the tests are so slow with this patch and I'll create a follow-up trac ticket that we'll have to address and identify the problematic change before beta1 while still allowing follow-up backports to happen in the meantime.

What @youknowriad suggests seems logical to me, especially if performance tests don't suggest major regressions that a user would experience.

We should not block the packages sync but be sure to followup _in short order_ with debugging _why_ the PHP tests have required a increased timeout.

In terms of performance, looking at the diff I’m suspicious of the PHP changes to the Navigation and Navigation Link blocks.

There have been two major changes:

• ​https://github.com/WordPress/gutenberg/pull/57754 - added support for hooked blocks.
• ​https://github.com/WordPress/gutenberg/pull/54801 - added support for all post/taxonomy variations to block.

There was also ​https://github.com/WordPress/gutenberg/pull/57979 but that just moved all existing rendering code into a class so that's probably the least likely source.

We should start investigating those. Any suggestions for workflows to validate before/after would be greatly appreciated.

@getdave That's good starting point.

The test run fails for some versions even with 60mn of timeout, basically I think we'd need something like 70mn for all the tests to pass. It's a lot. Let's give it one more day before committing this and in the mean time, let's try to comment some of that suspicious code you just shared to see if we find anything.

Let's give it one more day before committing this and in the mean time, let's try to comment some of that suspicious code you just shared to see if we find anything.

60 minutes seems excessive. It would be good to try a little bit more debugging first.

I'll try a fork which removes the changes to Nav files so we can rule those changes in/out.

Folks I think the culprit is the Navigation Link block file src/wp-includes/blocks/navigation-link.php. Specifically changes made in this PR ​https://github.com/WordPress/gutenberg/pull/54801/.

You can see that on ​my fork of this packages sync PR I have reverted the synced changes introduced to src/wp-includes/blocks/navigation-link.php and all the Unit Tests run successfully.

I suspect that ​these two lines need to be looked at carefully.

Please see ​https://github.com/WordPress/wordpress-develop/pull/5967#issuecomment-1915047869

I believe ​https://github.com/WordPress/gutenberg/pull/58389 will resolve our unit test problem.

@getdave Thanks for the update above! I missed it while performing my review. Just wanted it clear that my feedback was given without your new context, so read it with that lens.

With the last commit, I was able to add a code to the bootstrap of the php unit tests to unregister the problematic hooks. Now the tests run properly.

This is going to help us unblock this PR while we work on the different follow-ups for the next package upgrade.

[youknowriad]

In 57377:

Editor: Update the WordPress packages to the Gutenberg 16.7 RC2 version.

This patch, somewhat small brings a lot to WordPress.
This includes features like:

• DataViews.
• Customization tools like box shadow, background size and repeat.
• UI improvements in the site editor.
• Preferences sharing between the post and site editors.
• Unified panels and editors between post and site editors.
• Improved template mode in the post editor.
• Iterations to multiple interactive blocks.
• Preparing the blocks and UI for pattern overrides.
• and a lot more.

Props luisherranz, gziolo, isabel_brison, costdev, jonsurrell, peterwilsoncc, get_dave, antonvlasenko, desrosj.
See #60315.

[youknowriad]

I'm leaving this ticket open because there are a number of follow-ups that are yet to be addressed.

• There are some functions that have been removed without deprecation (raised by @desrosj)
• We need to update the way the navigation link registers the variations to avoid potential performance issues in unit tests. (currently being addressed by @gaambo and @get_dave

There are also some minor code styles changes that will be part of the next package upgrade.

I went ahead and landed a first version of the package update PR in https://core.trac.wordpress.org/changeset/57377
This will unblock the other backports from the Gutenberg repository.

I've left the ticket open for follow-ups, mainly the deprecated functions and the change for the navigation link variations.

Trac ticket: https://core.trac.wordpress.org/ticket/60315

Currently, Gutenberg's latest version is not compatible with WordPress trunk. The following issue triggers.

PHP Fatal error:  Cannot declare class WP_REST_Navigation_Fallback_Controller, because the name is already in use in… class-wp-rest-navigation-fallback-controller.php

This issue is already solved in Gutenberg trunk and will be included in tomorrow's 17.6 stable release.

This changes the Gutenberg minimum compatible version number from 16.5 to 17.6. For versions older than 16.5, the plugin will deactivate when upgrading WordPress to 6.5 beta1 or newer.

Changes are done within Core's _upgrade_core_deactivate_incompatible_plugins() which is invoked during WordPress' upgrade process.

I think the correct error message should be:

PHP Fatal error: Cannot declare class WP_Navigation_Block_Renderer, because the name is already in use in plugins/gutenberg/lib/compat/wordpress-6.5/class-wp-navigation-block-renderer.php on line 16

[youknowriad]

In 57384:

Editor: Update the minimum compatible version of Gutenberg.

Previous Gutenberg versions are not compatible with recent trunk because of the
WP_Navigation_Block_Renderer classname. It's present in both.

Gutenberg has been updated to avoid the use of this class but we need to auto-disable
old plugins to avoid fatals.

Props hellofromtonya.
See #60315.

Commit https://core.trac.wordpress.org/changeset/57384

Trac ticket: https://core.trac.wordpress.org/ticket/60315

This PR updates the WordPress packages to the latest version (which is current Gutenberg 17.6 RC3)
It brings with a set of iterations and follow-ups to the initial PR #30428
It also fixes a regression that happened for interactive blocks.

closing this one now, follow-up here #5984

There are some remaining comments I left, but they aren't blockers for this PR.

[youknowriad]

In 57499:

Editor: Update WordPress packages to Gutenberg 16.7 RC3.

It brings with a set of iterations and follow-ups to the initial package update.
It also fixes a regression that happened for interactive blocks.

Props gziolo, luisherranz, cbravobernal.
See #60315.

commit https://core.trac.wordpress.org/changeset/57499

Trac ticket: https://core.trac.wordpress.org/ticket/60315

Updates the WordPress packages with the one included with the Gutenberg 17.7 RC1 release. This is very close to what we'll have for WordPress 6.5 beta1.

Going to land this to let people test WordPress trunk with the latest Gutenberg over the weekend prior to beta 1.

[youknowriad]

In 57578:

Editor: Update the WordPress packages to Gutenberg 17.7RC1.

This brings the latest and greatest from Gutenberg.
The full changelog is available here
​https://github.com/WordPress/gutenberg/releases/tag/v17.7.0-rc.1

Props youknowriad, get_dave.
See #60315.

Commit https://core.trac.wordpress.org/changeset/57578

Trac ticket: https://core.trac.wordpress.org/ticket/60315

Updates the WordPress packages with the one included with the latest bug fixes from Gutenberg. This is probably the latest package update for WP 6.5 beta1.

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/58964

[youknowriad]

In 57619:

Editor: Update Packages with the latest bug fixes for 6.5 beta1.

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/58964

Props youknowriad, get_dave.
See #60315.

Commit in https://core.trac.wordpress.org/changeset/57619

Trac ticket: https://core.trac.wordpress.org/ticket/60315

Updates the WordPress packages with the one included with the latest bug fixes from Gutenberg. This is probably the latest package update for WP 6.5 Beta 2

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59197

This is testing well for me so far.

[youknowriad]

In 57663:

Editor: Update Packages with the latest bug fixes for 6.5 beta 2.

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59197

Props youknowriad, get_dave.
See #60315.

Commit https://core.trac.wordpress.org/changeset/57663

Trac ticket: https://core.trac.wordpress.org/ticket/60315

Updates the WordPress packages with the one included with the latest bug fixes from Gutenberg. This is the latest package update for WP 6.5 Beta 2.

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59208

These PRs were missed by the script in the initial backport.

[youknowriad]

In 57669:

Editor: Update Packages with the latest bug fixes for 6.5 beta 2 (Round 2).

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59208

See #60315.

Commit https://core.trac.wordpress.org/changeset/57669

Sync Gutenberg to WP Core for WordPress 6.5 Beta 3

Trac ticket: https://core.trac.wordpress.org/ticket/60315

Noticing missing files. Investigating.

@swissspidy @dream-encode @youknowriad Gutenberg packages update for Beta 3.

I tested this both with and without the latest Gutenberg Plugin active and I noticed no errors.

I also verified a few of the bug fixes without the Gutenberg Plugin active to ensure the updates had been carried across.

Looking good to me as well.

[youknowriad]

In 57721:

Editor: Update Packages with the latest bug fixes for 6.5 beta 3

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59394/

Props get_dave, youknowriad.
See #60315.

Commit https://core.trac.wordpress.org/changeset/57721

Sync Gutenberg to WP Core for WordPress 6.5 RC 1. Based on ​this PR in the Gutenberg repo:

@getdave yes, the patch for that one is ready to. @swissspidy is just waiting for the current package update to land first.

[youknowriad]

In 57760:

Editor: Update Packages with the latest bug fixes for 6.5 RC 1

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59541/

Props get_dave, youknowriad, talldanwp.
See #60315.
Fixes #60665.

Commit https://core.trac.wordpress.org/changeset/57760

Packages update for the WP 6.5 RC2 release.

Based on ​https://github.com/WordPress/gutenberg/pull/59756

Trac ticket: https://core.trac.wordpress.org/ticket/60315

@ockham Pinging you here to check the changes to Navigation are as expected based on your fix for the entities issue that was uncovered during RC 1 🙏

Also @youknowriad @dream-encode @swissspidy

This PR is being ​discussed in WP Core Slack

@ockham Pinging you here to check the changes to Navigation are as expected based on your fix for the entities issue that was uncovered during RC 1 🙏

Confirming that it's fixed 🎉

The performance job seem to be failing, I doubt that it's limited to this PR but do we know anything about that?

Downloading update from ​https://wordpress.org/wordpress-6.1.1.zip...

Seems to be related to Docker unable to download this.

I'm re-publishing the @wordpress/* packages and will sync this branch up shortly.

We should also remove the pattern overrides code in this PR I think.

Packages were published and I've ​updated this PR to reflect the changes there.

Performance tests are failing due to errors during environment setup. Latest one is that it cannot download:

​https://downloads.wordpress.org/plugin/wordpress-importer.0.8.2.zip...

The link goes to 404.

@getdave That's just GitHub accidentally including the dots in the link. The actual download is https://downloads.wordpress.org/plugin/wordpress-importer.0.8.2.zip without dots, and that works.

[youknowriad]

In 57814:

Editor: Update Packages with the latest bug fixes for 6.5 RC 2

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59756/

Props get_dave, swissspidy, bernhard-reiter, youknowriad.
See #60315.

Tests are ✅ Please can we now commit this?

I think @youknowriad just did in https://core.trac.wordpress.org/changeset/57814, so closing

[swissspidy]

In 57816:

Editor: Update Packages with the latest bug fixes for 6.5 RC 2

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59756/

Reviewed by swissspidy.
Merges [57814] to the to the 6.5 branch.

Props get_dave, swissspidy, bernhard-reiter, youknowriad.
See #60315.

Packages sync for WP 6.5 RC 3.

Contains all changes from ​https://github.com/WordPress/gutenberg/pull/59949

Trac ticket: https://core.trac.wordpress.org/ticket/60315

Noting that there were some errors encountered on the Github Action when publishing the NPM packages. After investigation these appear to be have been non-critical.

As a precaution I've manually compared the packages published against the changes in the Gutenberg Cherry Pick PR and they marry up nicely.

@youknowriad @swissspidy @dream-encode Let's make sure to give this extra careful testing 🙏

This is looking good to me.

[youknowriad]

In 57851:

Editor: Update Packages with the latest bug fixes for 6.5 RC 3

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59949/

Props get_dave, youknowriad.
See #60315.

Commit in https://core.trac.wordpress.org/changeset/57851

[gziolo]

Code changes look good. I will take care of backporting to 6.5 branch.

[gziolo]

In 57852:

Editor: Update Packages with the latest bug fixes for 6.5 RC 3

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59949/

Props get_dave, youknowriad, gziolo.
Reviewed by youknowriad.
Merges [57851] to the 6.5 branch.
See #60315.

[o44czp8oqy]

Replying to gziolo:

In 57852:

Editor: Update Packages with the latest bug fixes for 6.5 RC 3

It includes all the backports from this Gutenberg PR ​https://github.com/WordPress/gutenberg/pull/59949/

Props get_dave, youknowriad, gziolo.
Reviewed by youknowriad.
Merges [57851] to the 6.5 branch.
See #60315.

Thanks

Syncs editor packages for WordPress 6.5 RC4.

Note ​these changes were triaged and approved by release leads in WP Slack.

Trac ticket: https://core.trac.wordpress.org/ticket/60315

cc @swissspidy @dream-encode @desrosj @youknowriad

⚠️ I have yet to test these changes. I will endeavour to do so first thing tomorrow UTC+0.

[desrosj]

In 57888:

Editor: Merge Editor bug fixes ahead of 6.5 RC4.

This merges several high priority bug fixes for the editor ahead of WordPress 6.5:

• ​https://github.com/WordPress/gutenberg/pull/60180
• ​https://github.com/WordPress/gutenberg/pull/60093
• ​https://github.com/WordPress/gutenberg/pull/60071
• ​https://github.com/WordPress/gutenberg/pull/60130
• ​https://github.com/WordPress/gutenberg/pull/59959
• ​https://github.com/WordPress/gutenberg/pull/60167

Props youknowriad, annezazu, mcsf, jsnajdr, mmaattiiaass, get_dave, scruffian, mikachan, grantmkin, andraganescu, scruffian, antosguillamot, fabiankaegy, huzaifaalmesbah, krupajnanda, colorful-tones, liviopv, mamaduka, kim88, poena, peterwilsoncc, wildworks, swissspidy, desrosj, jorbin.
Fixes #60315.

[desrosj]

Reopening to merge [57888] to 6.5.

Merged in https://core.trac.wordpress.org/changeset/57888.

[jorbin]

[57888] looks good for backport to the 6.5 branch

[swissspidy]

In 57891:

Editor: Merge Editor bug fixes ahead of 6.5 RC4.

This merges several high priority bug fixes for the editor ahead of WordPress 6.5:

• ​https://github.com/WordPress/gutenberg/pull/60180
• ​https://github.com/WordPress/gutenberg/pull/60093
• ​https://github.com/WordPress/gutenberg/pull/60071
• ​https://github.com/WordPress/gutenberg/pull/60130
• ​https://github.com/WordPress/gutenberg/pull/59959
• ​https://github.com/WordPress/gutenberg/pull/60167

Reviewed by jorbin, swissspidy.
Merges [57888] to the 6.5 branch.

Props youknowriad, annezazu, mcsf, jsnajdr, mmaattiiaass, get_dave, scruffian, mikachan, grantmkin, andraganescu, scruffian, antosguillamot, fabiankaegy, huzaifaalmesbah, krupajnanda, colorful-tones, liviopv, mamaduka, kim88, poena, peterwilsoncc, wildworks, swissspidy, desrosj, jorbin.
Fixes #60315.