Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting Error in elementary models installation in dbt-spark #1441

Closed
gargvipul1349 opened this issue Feb 29, 2024 · 1 comment
Closed

Getting Error in elementary models installation in dbt-spark #1441

gargvipul1349 opened this issue Feb 29, 2024 · 1 comment
Labels
Bug Something isn't working dbt package integration

Comments

@gargvipul1349
Copy link

gargvipul1349 commented Feb 29, 2024

Describe the bug
I am getting error in model dbt_metrics while running command dbt --cache-selected-only run --select elementary

 Runtime Error in model dbt_metrics (models/edr/dbt_artifacts/dbt_metrics.sql)
  Database Error
    org.apache.hive.service.cli.HiveSQLException: Error running query: [INTERNAL_ERROR] org.apache.spark.SparkException: [INTERNAL_ERROR] Unexpected table relation: HiveTableRelation [`spark_catalog`.`elementary`.`dbt_metrics`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, Data Cols: [unique_id#1017783, name#1017784, label#1017785, model#1017786, type#1017787, sql#1017788, timest..., Partition Cols: []]

similar error in models -

  • dbt_columns.sql
  • dbt_tests.sql
  • dbt_sources.sql
  • dbt_snapshots.sql
  • dbt_exposures.sql
  • dbt_seeds.sql
  • dbt_models.sql

To Reproduce
Steps to reproduce the behavior:
dbt --cache-selected-only run --select elementary
Screenshot 2024-02-29 at 21 00 11

Screenshots
If applicable, add screenshots to help explain your problem.

Environment (please complete the following information):

  • edr Version: [0.14.1]
  • dbt-spark [1.7.0]
  • dbt-core [1.7.0]
  • elementary-data==0.14.1
  • elementary-data[athena]==0.14.1

Additional context
dbt_project.yml

models:
  ## see docs: https://docs.elementary-data.com/
  elementary:
    ## elementary models will be created in the schema '<your_schema>_elementary'
    +schema: "elementary"

vars:
  elementary_full_refresh: false
@gargvipul1349 gargvipul1349 added Bug Something isn't working Triage 👀 labels Feb 29, 2024
@haritamar
Copy link
Collaborator

Hi @gargvipul1349 ,
Unfortunately at this point dbt-spark is not an officially supported adapter so we are not actively maintaining this integration, though we do enable community members to contribute fixes there.
If you'd like to contribute a fix to this issue please feel free to open a PR and re-open this issue.

Thanks,
Itamar

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working dbt package integration
Projects
None yet
Development

No branches or pull requests

2 participants