Is it possible to run a single dbt model as a task?

[luis-fnogueira]

I am opening this issue because I couldn't run a single dbt model as task in Airflow with Cosmos with one profile config. I wouldn't like to run a DbtDag or a DbtTaskGroup with all my models in my dbt folder. I would like to run just one model, specifying its path, using only on profile.yml. Is that possible?

I ran:

    dbt_task= DbtTaskGroup(
        group_id="dbt_task",
        project_config=ProjectConfig(
            (dbt_root_path / "my_project/models/some_model/").as_posix(),
        ),
        operator_args={"install_deps": True},
        profile_config=profile_config,
        default_args={"retries": 2},
    )

But I get a cosmos.exceptions.CosmosValueError: Could not find dbt_project.yml at {path}. I should either copy the dbt_project.yml from root or set the project_config as dbt_root_path / "my_project/ path, but it finds all models.

Is there a way to run a single model as a task or I have to run all models in the project invariably?

[tatiana]

Hi @luis-fnogueira , could you confirm which version of Cosmos you are using?

It seems there are two issues you're describing, that are unrelated:

1. Profile yml path

The error you described, cosmos.exceptions.CosmosValueError: Could not find dbt_project.yml at {path}, is related to not finding dbt_project.yml:

astronomer-cosmos/cosmos/config.py

Line 205 in 73a9ba2

raise CosmosValueError(f"Could not find {name} at {path}")

Cosmos can reference this file in any directory as long as the process running Airflow has permission to access it.

2. Running a single model

There are a few options. Similar to the dbt command, Cosmos exposes select and exclude. You could write a selector to pick the only model you're interested in running:
https://astronomer.github.io/astronomer-cosmos/configuration/selecting-excluding.html

Since you only want to run a model, another option would be to use a Cosmos operator directly, without the need of using DbtDag or DbtTaskGroup:

astronomer-cosmos/tests/operators/test_local.py

Lines 398 to 405 in 73a9ba2

	run_operator = DbtRunLocalOperator(
	profile_config=real_profile_config,
	project_dir=DBT_PROJ_DIR,
	task_id="run",
	dbt_cmd_flags=["--models", "stg_customers"],
	install_deps=True,
	append_env=True,
	)

[tatiana]

Since we don't have further details, we're closing this issue. Please, @luis-fnogueira reopen it with more information if you're still facing problems.