Meta tags for the 'new header' feature flag

[zackkrida]

Problem

Our new header feature flag and milestone represent a standalone version of Openverse, free from the w.org iframe. With this approach our canonical URL will no longer be w.org/openverse and will instead be our new domain name.

For this reason, we need to update our meta follow tags on the site.

Description

Pages that should be indexed by search engines are:

• The home page
• All content (non search) pages
• Search pages (any endpoint prefixed with /search/)

Pages that should not be indexed by search engines are:

• Single results. These are a form of duplicate content elsewhere on the web and aren't useful to index.

These changes should be made under the new header feature flag.

Alternatives

Additional context

Implementation

• 🙋 I would be interested in implementing this feature.