Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ilp): breaking change💥 - ILP and TextImport create VARCHAR instead of STRING columns #4476

Merged
merged 14 commits into from
May 16, 2024

Conversation

jerrinot
Copy link
Contributor

@jerrinot jerrinot commented May 7, 2024

Text import and ILP now create VARCHAR columns instead of STRING columns. VARCHAR type uses less disk space and is faster than STRING for most operations. Most users should use VARCHAR columns instead of STRING columns.

If VARCHAR type is not yet usable for a given use case, then you can opt out by setting this configuration option: cairo.legacy.string.column.type.default=true.

…olumns

ILP implicit column creation for string data now defaults to VARCHAR columns
instead of STRING. VARCHAR type uses less disk space and is faster than STRING
for most operations. Most users should use VARCHAR columns instead of STRING columns.

If for any reason VARCHAR type is not yet usable for a given use case, then you
can opt-out by setting this configuration option: line.use.legacy.string.default=true.
You can also explicitly create a target table instead of relying on ILP implicit
creation.
@jerrinot jerrinot mentioned this pull request May 7, 2024
28 tasks
@jerrinot jerrinot marked this pull request as ready for review May 7, 2024 09:41
@jerrinot jerrinot changed the title feat(ilp): breaking change💥 - TextImport creates VARCHAR instead of STRING columns feat(ilp): breaking change💥 - ILP and TextImport creates VARCHAR instead of STRING columns May 7, 2024
@jerrinot jerrinot marked this pull request as draft May 7, 2024 14:11
@jerrinot jerrinot changed the title feat(ilp): breaking change💥 - ILP and TextImport creates VARCHAR instead of STRING columns feat(ilp): breaking change💥 - ILP and TextImport create VARCHAR instead of STRING columns May 7, 2024
@jerrinot jerrinot marked this pull request as ready for review May 7, 2024 14:38
@nwoolmer nwoolmer added ILP Issues or changes relating to Influx Line Protocol Core Related to storage, data type, etc. ready for review labels May 8, 2024
core/src/main/java/io/questdb/PropertyKey.java Outdated Show resolved Hide resolved
ideoma
ideoma previously approved these changes May 8, 2024
@jerrinot jerrinot requested a review from ideoma May 15, 2024 12:03
ideoma
ideoma previously approved these changes May 16, 2024
@jerrinot
Copy link
Contributor Author

@ideoma I resolved a merge conflict and it dismissed your review. please re-approve. thanks!

@ideoma
Copy link
Collaborator

ideoma commented May 16, 2024

[PR Coverage check]

😍 pass : 55 / 57 (96.49%)

file detail

path covered line new line coverage
🔵 io/questdb/cutlass/line/tcp/DefaultLineTcpReceiverConfiguration.java 0 1 00.00%
🔵 io/questdb/cutlass/text/types/VarcharAdapter.java 16 17 94.12%
🔵 io/questdb/cutlass/text/types/TimestampUtf8Adapter.java 1 1 100.00%
🔵 io/questdb/PropServerConfiguration.java 2 2 100.00%
🔵 io/questdb/cutlass/text/DefaultTextConfiguration.java 1 1 100.00%
🔵 io/questdb/cutlass/text/TextMetadataDetector.java 2 2 100.00%
🔵 io/questdb/cutlass/text/types/DateUtf8Adapter.java 1 1 100.00%
🔵 io/questdb/cutlass/text/types/TypeManager.java 1 1 100.00%
🔵 io/questdb/cutlass/text/CsvFileIndexer.java 5 5 100.00%
🔵 io/questdb/PropertyKey.java 1 1 100.00%
🔵 io/questdb/cutlass/text/ParallelCsvFileImporter.java 6 6 100.00%
🔵 io/questdb/cutlass/text/types/StringAdapter.java 1 1 100.00%
🔵 io/questdb/cutlass/text/types/SymbolAdapter.java 1 1 100.00%
🔵 io/questdb/cutlass/text/CopyTask.java 4 4 100.00%
🔵 io/questdb/cutlass/text/TextLoader.java 8 8 100.00%
🔵 io/questdb/cutlass/text/CopyJob.java 5 5 100.00%

@bluestreak01 bluestreak01 merged commit 2ba7b5d into master May 16, 2024
24 checks passed
@bluestreak01 bluestreak01 deleted the jh_textimport_into_varchar branch May 16, 2024 13:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Core Related to storage, data type, etc. ILP Issues or changes relating to Influx Line Protocol ready for review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants