Skip to content

Fluss Flink Lookup function return null rather than PartitionNotExistException if cannot match paritition. #1317

@loserwang1024

Description

@loserwang1024

Search before asking

  • I searched in the issues and found nothing similar.

Fluss version

0.7.0 (latest release)

Please describe the bug 🐞

Currenly, when we use dim table, if partition is not found ,will thrown exception.

com.alibaba.fluss.exception.FlussRuntimeException: Failed to update metadata
	at com.alibaba.fluss.client.metadata.MetadataUpdater.updateMetadata(MetadataUpdater.java:270)
	at com.alibaba.fluss.client.metadata.MetadataUpdater.checkAndUpdatePartitionMetadata(MetadataUpdater.java:192)
	at com.alibaba.fluss.client.utils.ClientUtils.getPartitionId(ClientUtils.java:131)
	at com.alibaba.fluss.client.lookup.PrimaryKeyLookuper.lookup(PrimaryKeyLookuper.java:113)
	at com.alibaba.fluss.flink.source.lookup.FlinkAsyncLookupFunction.fetchResult(FlinkAsyncLookupFunction.java:143)
	at com.alibaba.fluss.flink.source.lookup.FlinkAsyncLookupFunction.asyncLookup(FlinkAsyncLookupFunction.java:126)
	at org.apache.flink.table.functions.AsyncLookupFunction.eval(AsyncLookupFunction.java:52)
	at LookupFunction$1083.asyncInvoke(Unknown Source)
	at org.apache.flink.table.runtime.operators.join.lookup.AsyncLookupJoinRunner.asyncInvoke(AsyncLookupJoinRunner.java:121)
	at org.apache.flink.table.runtime.operators.join.lookup.AsyncLookupJoinRunner.asyncInvoke(AsyncLookupJoinRunner.java:44)
	at org.apache.flink.streaming.api.operators.async.AsyncWaitOperator.processElement(AsyncWaitOperator.java:273)
	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:245)
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:217)
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:169)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:617)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop

Solution

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions