Skip to content

Commit 6f6a919

Browse files
committed
Update from SAP DITA CMS (squashed):
commit 6d74d910f840d10d24dcc8a4aa3e802e9d3d7505 Author: REDACTED Date: Tue Aug 5 15:11:42 2025 +0000 Update from SAP DITA CMS 2025-08-05 15:11:42 Project: dita-all/pug1751957928638 Project map: af2fcb3e6dd448f3af3c0ff9c70daaf9.ditamap Output: loioc25299a38b6448f889a43b42c9e5897d Language: en-US Builddable map: 678695d903b546e5947af69e56ed42b8.ditamap commit 9052c2fe22ad319c929692f437cc328a2cfe05e0 Author: REDACTED Date: Tue Aug 5 15:10:42 2025 +0000 Update from SAP DITA CMS 2025-08-05 15:10:42 Project: dita-all/pug1751957928638 Project map: af2fcb3e6dd448f3af3c0ff9c70daaf9.ditamap Output: loiod3d776bb52294a17b48298443a286f55 Language: en-US Builddable map: 89ab8c0ed18c432d8fb87551823e7de7.ditamap commit 623fb634f6e7e889b8ee967c56a2abdd2cd4b27a Author: REDACTED Date: Tue Aug 5 15:10:38 2025 +0000 Update from SAP DITA CMS 2025-08-05 15:10:38 Project: dita-all/pug1751957928638 Project map: af2fcb3e6dd448f3af3c0ff9c70daaf9.ditamap ################################################## [Remaining squash message was removed before commit...]
1 parent 59e0637 commit 6f6a919

File tree

120 files changed

+1355
-2373
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

120 files changed

+1355
-2373
lines changed
Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -2,21 +2,21 @@
22

33
<link rel="stylesheet" type="text/css" href="../css/sap-icons.css"/>
44

5-
# Acquiring Data in the Data Builder
5+
# Acquiring Data
66

77
Users with a modeler role can import data directly into the *Data Builder* from connections and other sources, and use flows to replicate, extract, transform and load data.
88

99
This topic contains the following sections:
1010

11-
- [Federate and Replicate Data in Remote Tables](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_federate_replicate)
12-
- [Extract, Transform, and Load Data with Data Flows](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_etl)
13-
- [Load Data from Multiple Objects with Replication Flows](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_replication_flows)
14-
- [Acquire Data from SAP S/4HANA](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_s4)
15-
- [Acquire Data from SAP BW and SAP BW Bridge](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_bw_bridge)
16-
- [Import Data from CSV Files](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_import_csv)
17-
- [Purchase Data from Data Marketplace](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_marketplace)
18-
- [Create and Import Objects to Receive and Prepare Data](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_create_tables)
19-
- [Create Objects and Act On Existing Objects](acquiring-data-in-the-data-builder-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_tools)
11+
- [Federate and Replicate Data in Remote Tables](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_federate_replicate)
12+
- [Extract, Transform, and Load Data with Data Flows](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_etl)
13+
- [Load Data from Multiple Objects with Replication Flows](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_replication_flows)
14+
- [Acquire Data from SAP S/4HANA](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_s4)
15+
- [Acquire Data from SAP BW and SAP BW Bridge](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_bw_bridge)
16+
- [Import Data from CSV Files](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_import_csv)
17+
- [Purchase Data from Data Marketplace](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_marketplace)
18+
- [Create and Import Objects to Receive and Prepare Data](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_create_tables)
19+
- [Create Objects and Act On Existing Objects](acquiring-data-1f15a29.md#loio1f15a29a25354ec28392ab10ca4e9350__section_tools)
2020

2121
Space administrators and integrators prepare connections and other sources to allow modelers to acquire data \(see [Integrating Data and Managing Spaces in SAP Datasphere](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/8f98d3c917f94452bafe288055b60b35.html "Users with a space administrator or integrator role can create connections to source systems and databases and can schedule and monitor data replication and other data integration tasks. Space administrators are, additionally, responsible for controlling user access to their space, creating data access controls to secure data, enabling other forms of data integration, transporting content between tenants, and monitoring and otherwise managing the space.") :arrow_upper_right:\).
2222

@@ -102,7 +102,7 @@ You can import data from a CSV file to create a new local table \(see [Creating
102102

103103
## Purchase Data from Data Marketplace
104104

105-
Purchase data products from providers and download them directly into your space \(see [Purchasing Data from Data Marketplace](../purchasing-data-from-data-marketplace-4096fb8.md)\).
105+
Purchase data products from providers and download them directly into your space \(see <?sap-ot O2O class="- topic/xref " href="4096fb8c97dd4d84a7200941c1721368.xml" text="" desc="" xtrc="xref:47" xtrf="file:/home/builder/src/dita-all/pug1751957928638/loioc25299a38b6448f889a43b42c9e5897d_en-US/src/content/localization/en-us/f3888e57ce0a4afa9759abc3bdb9befd.xml" output-class="" outputTopicFile="file:/home/builder/tp.net.sf.dita-ot/2.3/plugins/com.elovirta.dita.markdown_1.3.0/xsl/dita2markdownImpl.xsl" ?> \).
106106

107107
You can become a data provider and offer your own data products for sale in Data Marketplace via the Data Sharing Cockpit \(see [Data Marketplace - Data Provider's Guide](https://help.sap.com/viewer/bb1899f0b39f415b9de29a845873d7af/DEV_CURRENT/en-US/e479b7b4c95741c7a7a1d42397984c7e.html "Users with a modeler role can create a data provider profile and publish data products to public, private, and internal Data Marketplaces.") :arrow_upper_right:\).
108108

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/creating-a-data-flow-e30fd14.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ Create a data flow to move and transform data in an intuitive graphical interfac
2020
2121
In addition to working with flows in the editor, you can also:
2222

23-
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
23+
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects and Tasks via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
2424
- Export and import them via the secure *Transport* app \(see [Transporting Content Between Tenants](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/df12666cf98e41248ef2251c564b0166.html "Users with an administrator or space administrator role can use the Transport app to transfer content between tenants via a private cloud storage area.") :arrow_upper_right:\).
2525
- Export and import them via CSN files \(see [Importing and Exporting Objects in CSN/JSON Files](../Creating-Finding-Sharing-Objects/importing-and-exporting-objects-in-csn-json-files-f8ff062.md)\).
2626

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/creating-a-local-table-2509fe4.md

Lines changed: 17 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ This procedure explains how to create an empty table by defining its columns. Yo
2020

2121
In addition to working with tables in the editor, you can also:
2222

23-
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
23+
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects and Tasks via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
2424
- Export and import them via the secure *Transport* app \(see [Transporting Content Between Tenants](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/df12666cf98e41248ef2251c564b0166.html "Users with an administrator or space administrator role can use the Transport app to transfer content between tenants via a private cloud storage area.") :arrow_upper_right:\).
2525
- Export and import them via CSN files \(see [Importing and Exporting Objects in CSN/JSON Files](../Creating-Finding-Sharing-Objects/importing-and-exporting-objects-in-csn-json-files-f8ff062.md)\).
2626

@@ -118,6 +118,22 @@ In addition to working with tables in the editor, you can also:
118118

119119

120120

121+
</td>
122+
</tr>
123+
<tr>
124+
<td valign="top">
125+
126+
Allow Data Transport
127+
128+
</td>
129+
<td valign="top">
130+
131+
\[dimensions only\] Enables users to include the table data when transporting the table in a repository package.
132+
133+
This feature is intended to allow you to transport data for static or slowly changing dimensions and can only be used to initialize data when importing the table for the first time.
134+
135+
See [Creating Packages to Export](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/24aba84ceeb3416881736f70f02e3a0a.html "Users with the DW Space Administrator role can create packages to model groups of related objects for transport between tenants. Modelers can add objects to packages via the Package field, which appears in editors when a package is created in their space. Once a package is complete and validated, the space administrator can export it to the Content Network. The structure of your package is preserved and, as the objects it contains evolve, you can easily export updated versions of it.") :arrow_upper_right:.
136+
121137
</td>
122138
</tr>
123139
<tr>

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/creating-a-local-table-file-d21881b.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -122,6 +122,22 @@ As a local table \(file\) is capturing delta changes via flows, it creates diffe
122122

123123

124124

125+
</td>
126+
</tr>
127+
<tr>
128+
<td valign="top">
129+
130+
Allow Data Transport
131+
132+
</td>
133+
<td valign="top">
134+
135+
\[dimensions only\] Enables users to include the table data when transporting the table in a repository package.
136+
137+
This feature is intended to allow you to transport data for static or slowly changing dimensions and can only be used to initialize data when importing the table for the first time.
138+
139+
See [Creating Packages to Export](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/24aba84ceeb3416881736f70f02e3a0a.html "Users with the DW Space Administrator role can create packages to model groups of related objects for transport between tenants. Modelers can add objects to packages via the Package field, which appears in editors when a package is created in their space. Once a package is complete and validated, the space administrator can export it to the Content Network. The structure of your package is preserved and, as the objects it contains evolve, you can easily export updated versions of it.") :arrow_upper_right:.
140+
125141
</td>
126142
</tr>
127143
<tr>

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/creating-a-python-operator-a747acf.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,9 @@ The *Python* operator allows data manipulation and vector operations by providin
1212

1313
The incoming `data` parameter in the `transform` function is of type Pandas DataFrame. The input table is converted into a DataFrame and fed into transform function as data parameter. You are expected to provide scripts for the intended transformation of the incoming DataFrame and also return a valid DataFrame from transform function. It is important that the returning DataFrame from the transform function has the same column names, types and order as the specified table for the output. Otherwise, execution of the data flow results in failure.
1414

15+
> ### Note:
16+
> The *Python* operator uses `mapInPandas` for parallel batch-wise processing. To ensure efficient and accurate data transformation, avoid performing global aggregation, grouping, or similar operations inside the Python code, as these require full dataset context. Instead, either use the *View Transform* operator for aggregation and grouping, or split the transformation flow to isolate operations requiring global context.
17+
1518
1. Drag and drop an object onto the source operator or select the *View Transform* to display its context menu, and click <span class="SAP-icons-TNT-V3"></span> Python operator to create the *Python* operator.
1619
2. Click the *Python* operator to display its properties in the side panel.
1720
3. In the *Script* section, enter your Python script to transform the incoming data and produce an output schema.

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/creating-a-replication-flow-25e2bd7.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ For more information about available connection types, sources, and targets, see
2828
>
2929
> In addition to working with flows in the editor, you can also:
3030
>
31-
> - List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
31+
> - List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects and Tasks via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
3232
> - Export and import them via the secure *Transport* app \(see [Transporting Content Between Tenants](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/df12666cf98e41248ef2251c564b0166.html "Users with an administrator or space administrator role can use the Transport app to transfer content between tenants via a private cloud storage area.") :arrow_upper_right:\).
3333
> - Export and import them via CSN files \(see [Importing and Exporting Objects in CSN/JSON Files](../Creating-Finding-Sharing-Objects/importing-and-exporting-objects-in-csn-json-files-f8ff062.md)\).
3434

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/creating-a-task-chain-d1afbc2.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ You can monitor the status of task chain runs from the Data Integration Monitor.
5151

5252
In addition to working with task chains in the editor, you can also:
5353

54-
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
54+
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects and Tasks via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
5555
- Export and import them via the secure *Transport* app \(see [Transporting Content Between Tenants](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/df12666cf98e41248ef2251c564b0166.html "Users with an administrator or space administrator role can use the Transport app to transfer content between tenants via a private cloud storage area.") :arrow_upper_right:\).
5656
- Export and import them via CSN files \(see [Importing and Exporting Objects in CSN/JSON Files](../Creating-Finding-Sharing-Objects/importing-and-exporting-objects-in-csn-json-files-f8ff062.md)\).
5757

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/deleting-local-table-file-records-6ec9b8a.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -38,10 +38,10 @@ Local Tables \(File\) store large amount of data, including historical data. Whe
3838
- *Delete previous versions \(Vacuum\), which are older than the specified number of days*: Records that meet your defined criteria will be permanently deleted. Default value is 90 days. Minimum authorized value is 7 so that records from the last 7 days cannot be deleted. In addition, only records that have been fully processed can be deleted.
3939

4040
> ### Note:
41-
> 7 days means start time of the task + 169 hours \(7 days X 24 hours + 1hour\). For more information about the 7 retention days and vacuum, see [Remove files no longer referenced by a Delta table](https://docs.delta.io/latest/delta-utility.html#remove-files-no-longer-referenced-by-a-delta-table)
41+
> 7 days means start time of the task - 169 hours \(7 days X 24 hours + 1hour\). For more information about the 7 retention days and vacuum, see [Remove files no longer referenced by a Delta table](https://docs.delta.io/latest/delta-utility.html#remove-files-no-longer-referenced-by-a-delta-table)
4242
4343
> ### Example:
44-
> If I decide to start the vacuum activity today February 4 at 10:00 am, and set the minimum value to 7 days, records inserted or changed between February 3, 10:00 am and February 10, 11:00 am won’t be deleted.
44+
> If I decide to start the vacuum activity today February 4 at 11:00 am, and set the minimum value to 7 days, records inserted or changed between February 3, 10:00 am and February 10, 11:00 am won’t be deleted.
4545
4646

4747
\[Optional\]. When you select one of these options, you can override the default *Apache Spark Application Settings* that were defined at space creation by your administrator:

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/google-bigquery-targets-56d4472.md

Lines changed: 2 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -37,21 +37,14 @@ The *Delete All Before Loading* setting is not available.
3737

3838
The target container is a Google BigQuery **dataset**.
3939

40+
Tables and column names must have valid names, containing letters, numbers and underscores \(\_\) only.
41+
4042

4143

4244
<a name="loio56d4472a0e1f44d58e07ca26ab666328__section_ReplFlow_GBQ_TargetTables"/>
4345

4446
## Target Tables
4547

46-
Target table names may only contain the following special characters:
47-
48-
- Hyphen \(-\)
49-
50-
- Underscore \(\_\)
51-
52-
- Space \( \)
53-
54-
5548
The maximum length for target column names is 300 characters.
5649

5750
Decimals with precision larger than 76 are not supported.

docs/Acquiring-Preparing-Modeling-Data/Acquiring-and-Preparing-Data-in-the-Data-Builder/importing-tables-and-views-from-sources-7c4acd3.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,7 @@ As these sources are already integrated into SAP Datasphere in staging tables ne
6565

6666
In addition to working with tables in the editor, you can also:
6767

68-
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
68+
- List, create, read, update, and delete them using the `datasphere` command line interface \(see [Manage Modeling Objects and Tasks via the Command Line](https://help.sap.com/viewer/9b8363ae47c347de9a027c0e5567a37a/DEV_CURRENT/en-US/6f5c65f209004751aa48f9682ee2ec45.html "Users with a modeler role can use the datasphere command line interface to list, create, update, and delete modeling objects.") :arrow_upper_right:\).
6969
- Export and import them via the secure *Transport* app \(see [Transporting Content Between Tenants](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/df12666cf98e41248ef2251c564b0166.html "Users with an administrator or space administrator role can use the Transport app to transfer content between tenants via a private cloud storage area.") :arrow_upper_right:\).
7070
- Export and import them via CSN files \(see [Importing and Exporting Objects in CSN/JSON Files](../Creating-Finding-Sharing-Objects/importing-and-exporting-objects-in-csn-json-files-f8ff062.md)\).
7171

0 commit comments

Comments
 (0)