Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Weaviate Auto Schema #42

Open
Tracked by #97
samos123 opened this issue Nov 28, 2022 · 2 comments
Open
Tracked by #97

Support Weaviate Auto Schema #42

samos123 opened this issue Nov 28, 2022 · 2 comments

Comments

@samos123
Copy link
Collaborator

Currently the class has to be precreated in Weaviate for the Spark Connector to work. However, it might be possible to rely on auto schema creation instead, but this would require some changes to how inferSchema works in the Spark Connector: https://weaviate.io/developers/weaviate/current/schema/schema-configuration.html#auto-schema

@tickx-cegeka
Copy link

This would be a great addition still in 2024, could someone look at this again?

@hsm207
Copy link

hsm207 commented May 29, 2024

auto schema is might not be a good idea. what if the doc to be ingested has an unexpected field?

maybe make it make it toggle-able? like, use it only for dev, and when go to prod, turn it off?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants