Skip to content

Commit 05c8310

Browse files
committed
Fix more links
1 parent 80c2955 commit 05c8310

File tree

7 files changed

+90
-8
lines changed

7 files changed

+90
-8
lines changed

README.md

Lines changed: 84 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
# Documentation landing page
1+
# Hopsworks Documentation
22

3-
This is the source of the landing page for <https://docs.hopsworks.ai>
3+
This is the source of the Hopsworks Documentation published at <https://docs.hopsworks.ai>.
44

55
## Build instructions
66

@@ -57,3 +57,85 @@ linkchecker http://127.0.0.1:8000/
5757
# If ok just kill the server
5858
kill -9 $SERVER_PID
5959
```
60+
61+
## Setup and Build Documentation
62+
63+
We use `mkdocs` together with `mike` ([for versioning](https://github.com/jimporter/mike/)) to build the documentation and a plugin called `keras-autodoc` to auto generate Python API documentation from docstrings.
64+
65+
**Background about `mike`:**
66+
`mike` builds the documentation and commits it as a new directory to the gh-pages branch.
67+
Each directory corresponds to one version of the documentation.
68+
Additionally, `mike` maintains a json in the root of gh-pages with the mappings of versions/aliases for each of the directories available.
69+
With aliases you can define extra names like `dev` or `latest`, to indicate stable and unstable releases.
70+
71+
### Versioning on docs.hopsworks.ai
72+
73+
On docs.hopsworks.ai we implement the following versioning scheme:
74+
75+
- current master branches (e.g. of hopsworks corresponding to master of Hopsworks): rendered as current Hopsworks snapshot version, e.g. **4.0.0-SNAPSHOT [dev]**, where `dev` is an alias to indicate that this is an unstable version.
76+
- the latest release: rendered with full current version, e.g. **3.8.0 [latest]** with `latest` alias to indicate that this is the latest stable release.
77+
- previous stable releases: rendered without alias, e.g. **3.4.4**.
78+
79+
### 4. Build Instructions
80+
81+
For this you can either checkout and make a local copy of the `upstream/gh-pages` branch, where `mike` maintains the current state of docs.hopsworks.ai, or just build documentation for the branch you are updating:
82+
83+
Building *one* branch:
84+
85+
Checkout your dev branch with modified docs:
86+
87+
```bash
88+
git checkout [dev-branch]
89+
```
90+
91+
Generate API docs if necessary:
92+
93+
```bash
94+
python auto_doc.py
95+
```
96+
97+
Build docs with a version and alias
98+
99+
```bash
100+
mike deploy [version] [alias] --update-alias
101+
102+
# for example, if you are updating documentation to be merged to master,
103+
# which will become the new SNAPSHOT version:
104+
mike deploy 4.0.0-SNAPSHOT dev --update-alias
105+
106+
# if you are updating docs of the latest stable release branch
107+
mike deploy [version] latest --update-alias
108+
109+
# if you are updating docs of a previous stable release branch
110+
mike deploy [version]
111+
```
112+
113+
If no gh-pages branch existed in your local repository, this will have created it.
114+
115+
**Important**: If no previous docs were built, you will have to choose a version as default to be loaded as index, as follows
116+
117+
```bash
118+
mike set-default [version-or-alias]
119+
```
120+
121+
You can now checkout the gh-pages branch and serve:
122+
123+
```bash
124+
git checkout gh-pages
125+
mike serve
126+
```
127+
128+
You can also list all available versions/aliases:
129+
130+
```bash
131+
mike list
132+
```
133+
134+
Delete and reset your local gh-pages branch:
135+
136+
```bash
137+
mike delete --all
138+
139+
# or delete single version
140+
mike delete [version-or-alias]
141+
```

docs/setup_installation/admin/oauth2/create-okta-client.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ You can also create mappings from groups in Okta to groups in Hopsworks.
4747
To achieve this you need to configure Okta to send _Groups_ with user information.
4848
To do this go to _Applications_ and select your application name.
4949
In the _Sign On_ tab click edit _OpenID Connect ID Token_ and select **Filter** for _Groups claim type_, then for _Groups claim filter_ add **groups** as the claim name, select **Match Regex** from the dropdown and .* (dot star) as Regex to match all groups.
50-
See [Group mapping](./create-client.md#group-mapping) on how to do the mapping in Hopsworks.
50+
See [Group mapping](./create-client.md#step-2-add-group-mappings) on how to do the mapping in Hopsworks.
5151

5252
<figure>
5353
<img src="../../../../assets/images/admin/oauth2/okta-groups.png" alt="Group claim" />

docs/user_guides/fs/data_source/creation/redshift.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ Start by giving it a **name** and an optional **description**.
6969

7070
!!! warning "Session Duration"
7171
By default, the session duration that the role will be assumed for is 1 hour or 3600 seconds.
72-
This means if you want to use the data source for example to [read or create an external Feature Group from Redshift](../usage.md##creating-an-external-feature-group), the operation cannot take longer than one hour.
72+
This means if you want to use the data source for example to [read or create an external Feature Group from Redshift](../usage.md#creating-an-external-feature-group), the operation cannot take longer than one hour.
7373

7474
Your administrator can change the default session duration for AWS data sources, by first [increasing the max session duration of the IAM Role](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use.html#id_roles_use_view-role-max-session) that you are assuming.
7575
And then changing the `fs_data_source_session_duration` [configuration property](../../../../setup_installation/admin/variables.md) to the appropriate value in seconds.

docs/user_guides/fs/feature_group/on_demand_transformations.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ Each on-demand transformation function can generate one or multiple on-demand fe
1010
If the on-demand transformation function returns a single feature, it is automatically assigned the same name as the transformation function.
1111
However, if it returns multiple features, they are by default named using the format `functionName_outputColumnNumber`.
1212
For instance, in the example below, the on-demand transformation function `transaction_age` produces an on-demand feature named `transaction_age` and the on-demand transformation function `stripped_strings` produces the on-demand features names `stripped_strings_0` and `stripped_strings_1`.
13-
Alternatively, the name of the resulting on-demand feature can be explicitly defined using the [`alias`](../transformation_functions.md#specifying-output-featuresnames-for-transformation-functions) function.
13+
Alternatively, the name of the resulting on-demand feature can be explicitly defined using the [`alias`](../transformation_functions.md#specifying-output-features-names-for-transformation-functions) function.
1414

1515
!!! warning "On-demand transformation"
1616
All on-demand transformation functions attached to a feature group must have unique names and, in contrast to model-dependent transformations, they do not have access to training dataset statistics.

docs/user_guides/fs/feature_view/batch-data.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ Please note that transformed batch data can only be returned in the python clien
6464
feature_view.init_batch_scoring(training_dataset_version=1)
6565
```
6666

67-
It is important to note that in addition to the filters defined in feature view, [extra filters](./training-data.md#Extra-filters) will be applied if they are defined in the given training dataset version.
67+
It is important to note that in addition to the filters defined in feature view, [extra filters](./training-data.md#extra-filters) will be applied if they are defined in the given training dataset version.
6868

6969
## Retrieving untransformed batch data
7070

docs/user_guides/fs/feature_view/model-dependent-transformations.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ Hopsworks by default generates default names of transformed features output by a
2323
The generated names follows a naming convention structured as `functionName_features_outputColumnNumber` if the transformation function outputs multiple columns and `functionName_features` if the transformation function outputs one column.
2424
For instance, for the function named `add_one_multiple` that outputs multiple columns in the example given below, produces output columns that would be labeled as  `add_one_multiple_feature1_feature2_feature3_0``add_one_multiple_feature1_feature2_feature3_1` and  `add_one_multiple_feature1_feature2_feature3_2`.
2525
The function named `add_two` that outputs a single column in the example given below, produces a single output column names as `add_two_feature`.
26-
Additionally, Hopsworks also allows users to specify custom names for transformed feature using the [`alias`](../transformation_functions.md#specifying-output-featuresnames-for-transformation-functions) function.
26+
Additionally, Hopsworks also allows users to specify custom names for transformed feature using the [`alias`](../transformation_functions.md#specifying-output-features-names-for-transformation-functions) function.
2727

2828
=== "Python"
2929

docs/user_guides/mlops/serving/deployment.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -219,7 +219,7 @@ Artifact versions are unique for the same model version.
219219

220220
When a new deployment is created, a new artifact version is generated in two cases:
221221

222-
- the artifact version in the predictor is set to `CREATE` (see [Artifact Version](./predictor.md#artifact_version))
222+
- the artifact version in the predictor is set to `CREATE` (see [Artifact Version](./predictor.md#environment-variables))
223223
- no model artifact with the same files has been created before.
224224

225225
Inside a model deployment, the local path to the artifact files is stored in the `ARTIFACT_FILES_PATH` environment variable (see [environment variables](../serving/predictor.md#environment-variables)).

0 commit comments

Comments
 (0)