Support writing a dataframe that only contains subset of Weaviate class

[samos123]

Assume you have Weaviate class:

Article (title: String, content: String)

However your Spark dataframe also has an author column then I should still be able to write a the dataframe to Weaviate as long as it has the title and content columns.

This might simply not be possible due to the way Spark DataSource and DataWriter interfaces are implemented

[samos123]

I think one way could be to have an ignore list as option and inferSchema will ignore any columns in the dataframe that are in the ignore list.