Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Converting Date to String using Select values Meta-data Tab not working on Linux #3893

Open
Zusammenarbeit-GIP-RZV opened this issue Apr 29, 2024 · 1 comment

Comments

@Zusammenarbeit-GIP-RZV
Copy link

Apache Hop version?

2.8

Java version?

openjdk11-jre

Operating system

Docker

What happened?

I tried to execute a converted Pipeline (converted from kettle) using your apache/hop:latest Docker Image.
But it is failing on this image, and not on my windows machine.
I attached a simplified example. I use "Get system info" to get the "System date (fixed)" and want to convert it to a String with a specific format. Usually I do this using the "Select values" transforms "Meta-data" Tab. But this Step is failing with the following error:
2024/04/29 07:23:05 - test - Error storing execution data 2024/04/29 07:23:05 - test - date_fixed Date : There was a data type error: the data type of java.lang.String object [20240429072305] does not correspond to value meta [Date] (through reference chain: org.apache.hop.execution.ExecutionData["rowsBinaryGzipBase64Encoded"]) 2024/04/29 07:23:05 - test - 2024/04/29 07:23:05 - test - at org.apache.hop.execution.local.FileExecutionInfoLocation.registerData(FileExecutionInfoLocation.java:342) 2024/04/29 07:23:05 - test - at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.stopTransformExecutionInfoTimer(LocalPipelineEngine.java:509) 2024/04/29 07:23:05 - test - at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.pipelineCompleted(LocalPipelineEngine.java:465) 2024/04/29 07:23:05 - test - at org.apache.hop.pipeline.Pipeline.firePipelineExecutionFinishedListeners(Pipeline.java:1339) 2024/04/29 07:23:05 - test - at org.apache.hop.pipeline.Pipeline.lambda$startThreads$0(Pipeline.java:1142) 2024/04/29 07:23:05 - test - at org.apache.hop.pipeline.transform.BaseTransform.fireTransformFinishedListeners(BaseTransform.java:2825) 2024/04/29 07:23:05 - test - at org.apache.hop.pipeline.transform.BaseTransform.markStop(BaseTransform.java:2814) 2024/04/29 07:23:05 - test - at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:142) 2024/04/29 07:23:05 - test - at java.base/java.lang.Thread.run(Thread.java:829) 2024/04/29 07:23:05 - test - Caused by: com.fasterxml.jackson.databind.JsonMappingException: date_fixed Date : There was a data type error: the data type of java.lang.String object [20240429072305] does not correspond to value meta [Date] (through reference chain: org.apache.hop.execution.ExecutionData["rowsBinaryGzipBase64Encoded"]) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:402) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:361) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ser.std.StdSerializer.wrapAndThrow(StdSerializer.java:323) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:780) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:178) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:479) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:318) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ObjectWriter$Prefetch.serialize(ObjectWriter.java:1572) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ObjectWriter._writeValueAndClose(ObjectWriter.java:1273) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java:1098) 2024/04/29 07:23:05 - test - at org.apache.hop.execution.local.FileExecutionInfoLocation.registerData(FileExecutionInfoLocation.java:339) 2024/04/29 07:23:05 - test - ... 8 more 2024/04/29 07:23:05 - test - Caused by: java.lang.RuntimeException: date_fixed Date : There was a data type error: the data type of java.lang.String object [20240429072305] does not correspond to value meta [Date] 2024/04/29 07:23:05 - test - at org.apache.hop.core.row.value.ValueMetaBase.writeData(ValueMetaBase.java:3106) 2024/04/29 07:23:05 - test - at org.apache.hop.core.row.RowMeta.writeData(RowMeta.java:717) 2024/04/29 07:23:05 - test - at org.apache.hop.execution.ExecutionData.getRowsBinaryGzipBase64Encoded(ExecutionData.java:190) 2024/04/29 07:23:05 - test - at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2024/04/29 07:23:05 - test - at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2024/04/29 07:23:05 - test - at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2024/04/29 07:23:05 - test - at java.base/java.lang.reflect.Method.invoke(Method.java:566) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:688) 2024/04/29 07:23:05 - test - at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:772) 2024/04/29 07:23:05 - test - ... 15 more

Conversion Error Example.zip

Issue Priority

Priority: 2

Issue Component

Component: Transforms

@bamaer
Copy link
Contributor

bamaer commented May 2, 2024

your pipeline probably runs just fine, the error comes from the execution information location that we seem to have active in the container.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants