You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
`readStreamInput` resolves the given `name` (in the given [FlowAnalysisContext](FlowAnalysisContext.md)).
108
+
109
+
For an `InternalDatasetIdentifier` (that is defined by the current pipeline), `readStreamInput`[readGraphInput](#readGraphInput).
110
+
111
+
For an `ExternalDatasetIdentifier` (that is external to the current pipeline), `readStreamInput`[readExternalStreamInput](#readExternalStreamInput).
108
112
109
113
---
110
114
@@ -133,7 +137,22 @@ readGraphInput(
133
137
readOptions: InputReadOptions):DataFrame
134
138
```
135
139
136
-
`readGraphInput`...FIXME
140
+
!!! note "Load DataFrame"
141
+
It is up to the [Input](Input.md) (for the given `InternalDatasetIdentifier`) to [load a DataFrame](Input.md#load) that may either be batch or streaming.
142
+
143
+
`readGraphInput` records the input dataset identifier in the given [FlowAnalysisContext](FlowAnalysisContext.md#requestedInputs).
144
+
145
+
??? note "SparkException"
146
+
For a dataset not defined in the dataflow graph (the given `InternalDatasetIdentifier` not being available in the [FlowAnalysisContext](FlowAnalysisContext.md#allInputs)),
147
+
`readGraphInput` reports a `SparkException`.
148
+
149
+
`readGraphInput` finds the [Input](Input.md) for the given `InternalDatasetIdentifier` (in the [FlowAnalysisContext](FlowAnalysisContext.md#availableInput)).
150
+
151
+
`readGraphInput` requests the `Input` to [load a DataFrame](Input.md#load) (with the given [InputReadOptions](InputReadOptions.md)).
152
+
153
+
`readGraphInput` records a `ResolvedInput` in the [FlowAnalysisContext](FlowAnalysisContext.md) (in [streamingInputs](FlowAnalysisContext.md#streamingInputs) or [batchInputs](FlowAnalysisContext.md#batchInputs) for `StreamingReadOptions` or `BatchReadOptions`, respectively).
154
+
155
+
In the end, `readGraphInput` creates a (streaming or batch) `Dataset`.
0 commit comments