feature: meltano compile - expand stream attributes in manifest.json

[jaceksan]

Feature scope

Configuration (settings parsing, validation, etc.)

Description

meltano compile creates manifest.json.
The problem is that it does not expand attributes in streams.
Example: using tap-github, I declare workflows.*. When I run the compile, manifest.json contains workflows.*, the wildcard is not expanded.

Current workaround solution:
Run meltano select --list --all and extract selected (and expanded) attributes for the workflows stream.
It is not an ideal workaround because meltano select command is much slower than meltano compile.

Questions:
Would it be feasible to extend the meltano compile command accordingly?
If yes, I can contribute, if anyone is so kind as to guide me.

Answer from @edgarrmondragon:

I think so:

• The Manifest.data would be the place where this happens
• You might need to instantiate an invoker for each extractor plugin
• The PluginInvoker.files property holds a mapping with the catalog key pointing the catalog file

It's possible that implementing this makes meltano compile somewhat slower. We could make it optional, though.