Skip to content

Commit f290727

Browse files
Simran-Bmdawassachinsharma9780maxkernbachnerpaula
authored
DOC-730 | GenAI Suite (#696)
* WIP * Fix image * adding natural language service documentation * remove dev guide of NL service; was added by mistake * add user-facing-documentation for ragloader * add user-facing-documentation for ragretriever * WIP: Add platform overview content from #671 * add user-facing-documentation for genai * add user-facing-documentation for arangodb-mlflow * Re-arrange content * Fix links * fix conflicts * rework graph rag main page * formatting * more formatting * add initial docs for triton * mark txt2aql as draft (available only in q3) * adjust triton, headlines, add links * add info about private and public llms * add initial graphrag notebook tutorial draft * add links and examples to notebook servers page * update triton page * Fix merge issue with AG notebooks * Add Platform feature list * Formatting * add platform tag * remove password field from tutorial, fix typo * Single feature list for prerelease * terminology: use importer and retriever * add pre-release and get in touch note * add more cross references * add pre-release note to remaining pages * update GraphML screenshot * Platform requirements, installation, and interfaces * API reference links * Update Data Science card, add Platform card * Move GraphML under GenAI Suite in Platform overview * Consistently capitalize it as GenAI Suite (uppercase S) * Add GraphRAG limitations * add GraphRAG web interface docs * Apply suggestions from code review Co-authored-by: Heiko <[email protected]> Co-authored-by: Simran <[email protected]> Co-authored-by: Diego M-R <[email protected]> * Add and use kbd shortcode for keyboard shortcuts * Partially address feedback * move general KG definition * incorporate feedback * Review * Review * Formatting --------- Co-authored-by: Mohammad Dawas <[email protected]> Co-authored-by: sachinsharma9780 <[email protected]> Co-authored-by: maxkernbach <[email protected]> Co-authored-by: Paula <[email protected]> Co-authored-by: Paula Mihu <[email protected]> Co-authored-by: Heiko <[email protected]> Co-authored-by: Diego M-R <[email protected]>
1 parent 91f0f0f commit f290727

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

47 files changed

+2635
-190
lines changed

README.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -425,6 +425,15 @@ Available attributes:
425425
- `class`: CSS classes to apply
426426
- `style`: CSS inline styles to apply
427427

428+
#### Keyboard shortcuts
429+
430+
To document hotkeys and key combinations to press in a terminal or graphical
431+
user interface, use the `kbd` shortcode:
432+
433+
```markdown
434+
Hit {{< kbd "Ctrl Return" >}} respectively {{< kbd "Cmd Return" >}} to run the query.
435+
```
436+
428437
#### Cards
429438

430439
To prominently link to other content, you may use cards:

site/content/3.13/_index.md

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,8 +26,13 @@ ArangoDB's Query Language AQL lets you use graphs, JSON documents, and search
2626
via a single, composable query language.
2727
{{% /card %}}
2828

29-
{{% card title="Data Science" link="data-science/" %}}
30-
Discover the graph analytics and machine learning features of ArangoDB.
29+
{{% card title="GenAI & Data Science" link="data-science/" %}}
30+
Discover the graph-powered machine learning and GraphRAG features of ArangoDB.
31+
{{% /card %}}
32+
33+
{{% card title="ArangoDB Platform" link="components/platform/" %}}
34+
The ArangoDB Platform is the umbrella for hosting the entire ArangoDB offering
35+
of products, including GraphML and GraphRAG.
3136
{{% /card %}}
3237

3338
{{% card title="Deploy" link="deploy/" %}}

site/content/3.13/about-arangodb/features/_index.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,10 @@ aliases:
2121

2222
See the full [Feature list of the ArangoDB core database system](core.md).
2323

24+
For a scalable architecture based on Kubernetes that supports the full offering
25+
of ArangoDB including graph-powered machine learning and GenAI features, see
26+
the [Feature list of the ArangoDB Platform](platform.md).
27+
2428
## On-premises versus Cloud
2529

2630
### Fully managed cloud service
Lines changed: 57 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,57 @@
1+
---
2+
title: Feature list of the ArangoDB Platform
3+
menuTitle: ArangoDB Platform
4+
weight: 10
5+
description: >-
6+
The ArangoDB Platform is a scalable architecture that gets you all features
7+
of ArangoDB including graph-powered machine learning and GenAI as a single
8+
solution with a unified interface
9+
---
10+
For in-depth information about the ArangoDB Platform as a whole and how to
11+
deploy and use it, see [The ArangoDB Platform](../../components/platform.md).
12+
13+
## Architecture
14+
15+
- **Core Database**: The ArangoDB database system forms the solid core
16+
of the ArangoDB Platform.
17+
18+
- **Kubernetes**: An open-source container orchestration system for automating
19+
software deployment, scaling, and management designed by Google. It is the
20+
autopilot for operating ArangoDB clusters and the additional Platform services.
21+
22+
- **Helm**: A package manager for Kubernetes that enables consistent, repeatable
23+
installations and version control.
24+
25+
- **Envoy**: A high-performance service proxy that acts as the gateway for the
26+
ArangoDB Platform for centralizing authentication and routing.
27+
28+
- **Web interface**: The Platform includes a unified, browser-based UI that lets
29+
you access its features in an intuitive way. Optional products like the
30+
GenAI Suite seamlessly integrate into the UI if installed.
31+
32+
## Features
33+
34+
- [**ArangoDB Core**](core.md): The ArangoDB database system with support for
35+
graphs, documents, key-value, full-text search, and vector search.
36+
37+
- [**Graph Visualizer**](../../graphs/graph-visualizer.md):
38+
A web-based tool for exploring your graph data with an intuitive interface and
39+
sophisticated querying capabilities.
40+
41+
- [**Graph Analytics**](../../graphs/graph-analytics.md):
42+
A service that can efficiently load graph data from the core database system
43+
and run graph algorithms such as PageRank and many more.
44+
45+
- [**GenAI Suite**](../../data-science/_index.md):
46+
ArangoDB's graph-powered machine learning (GraphML) as well as GraphRAG for
47+
automatically building knowledge graphs from text and taking advantage of both
48+
excerpts and higher-level summaries as context for turbocharging GenAI
49+
applications.
50+
51+
- [**Notebook servers**](../../data-science/notebook-servers.md):
52+
Run Jupyter kernels in the Platform for hosting interactive, Python-based
53+
notebooks to experiment and develop applications.
54+
55+
- [**MLflow integration**](../../data-science/graphrag/services/mlflow.md):
56+
Use the popular MLflow for machine learning practitioners as part of the
57+
ArangoDB Platform.
Lines changed: 219 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,219 @@
1+
---
2+
title: The ArangoDB Platform
3+
menuTitle: Platform
4+
weight: 169
5+
description: >-
6+
The ArangoDB Platform brings everything ArangoDB offers together to a single
7+
solution that you can deploy on-prem or use as a managed service
8+
---
9+
{{< tip >}}
10+
The ArangoDB Platform & GenAI Suite is available as a pre-release. To get
11+
exclusive early access, [get in touch](https://arangodb.com/contact/) with
12+
the ArangoDB team.
13+
{{< /tip >}}
14+
15+
The ArangoDB Platform is a technical infrastructure that acts as the umbrella
16+
for hosting the entire ArangoDB offering of products. The Platform makes it easy
17+
to deploy and operate the core ArangoDB database system along with any additional
18+
ArangoDB products for machine learning, data explorations, and more. You can
19+
run it on-premises or in the cloud yourself on top of Kubernetes to access all
20+
of the platform features.
21+
22+
## Features of the ArangoDB Platform
23+
24+
- **Core database system**: The ArangoDB graph database system for storing
25+
interconnected data.{{< comment >}} You can use the free Community Edition or the commercial
26+
Enterprise Edition.{{< /comment >}}
27+
- **Graph Visualizer**: A web-based tool for exploring your graph data with an
28+
intuitive interface and sophisticated querying capabilities.
29+
- **Graph Analytics**: A suite of graph algorithms including PageRank,
30+
community detection, and centrality measures with support for GPU
31+
acceleration thanks to Nvidia cuGraph.
32+
- **GenAI Suite**: A set of machine learning services, APIs, and
33+
user interfaces that are available as a package as well as individual products.
34+
- **GraphML**: A turnkey solution for graph machine learning for prediction
35+
use cases such as fraud detection, supply chain, healthcare, retail, and
36+
cyber security.
37+
- **GraphRAG**: Leverage ArangoDB's graph, document, key-value,
38+
full-text search, and vector search features to streamline knowledge
39+
extraction and retrieval.
40+
{{< comment >}}TODO: Not available in prerelease version
41+
- **Txt2AQL**: Unlock natural language querying with a service that converts
42+
user input into ArangoDB Query Language (AQL), powered by fine-tuned
43+
private or public LLMs.
44+
{{< /comment >}}
45+
- **GraphRAG Importer**: Extract entities and relationships from large
46+
text-based files, converting unstructured data into a knowledge graph
47+
stored in ArangoDB.
48+
- **GraphRAG Retriever**: Perform semantic similarity searches or aggregate
49+
insights from graph communities with global and local queries.
50+
- **MLflow integration**: Use the popular MLflow for machine learning
51+
practitioners as part of the ArangoDB Platform.
52+
- **Jupyter notebooks**: Run a Jupyter kernel in the platform for hosting
53+
interactive notebooks for experimentation and development of applications
54+
that use ArangoDB as their backend.
55+
{{< comment >}}TODO: Mostly unrelated to Platform, vector index in core,
56+
- **Vector embeddings**: You can train machine learning models for later use
57+
in vector search in conjunction with the core database system's `vector`
58+
index type. It allows you to find similar items in your dataset.
59+
{{< /comment >}}
60+
61+
## Get started with the ArangoDB Platform
62+
63+
### Use the ArangoDB Platform as a managed service
64+
65+
The ArangoDB Platform is not available as a managed service yet, but it will
66+
become available for the [ArangoGraph Insights Platform](../arangograph/_index.md)
67+
in the future. Until then, you can request early access to the self-hosted
68+
ArangoDB Platform for testing.
69+
70+
### Self-host the ArangoDB Platform
71+
72+
You can set up and run the ArangoDB Platform on-premises or in the cloud and
73+
manage this deployment yourself.
74+
75+
#### Requirements for self-hosting
76+
77+
- **Early access to the ArangoDB Platform**:
78+
[Get in touch](https://arangodb.com/contact/) with the ArangoDB team to get
79+
exclusive early access to the pre-release of the ArangoDB Platform & GenAI Suite.
80+
81+
- **Kubernetes**: Orchestrates the selected services that comprise the
82+
ArangoDB Platform, running them in containers for safety and scalability.
83+
84+
Set up a [Kubernetes](https://kubernetes.io/) cluster if you don't have one
85+
available yet.
86+
87+
- **kubectl**: A command line tool for communicating with a Kubernetes cluster's
88+
control plane.
89+
90+
Install [kubectl](https://kubernetes.io/docs/tasks/tools/#kubectl) for applying
91+
specifications such as for creating the ArangoDB Core deployment, as well as
92+
for checking pods, logs, etc.
93+
94+
- **Helm**: A package manager for Kubernetes.
95+
96+
You need to have [helm](https://helm.sh/docs/intro/install/) installed in order
97+
to install the required certificate manager and the ArangoDB Kubernetes Operator
98+
as part of the Platform setup.
99+
100+
- **Container registry**: A repository for storing and accessing container images.
101+
102+
You need to have a container registry for installing the images of the Platform
103+
services. It can be a local registry.
104+
105+
{{< comment >}}
106+
- **Licenses**: If you want to use any paid features, you need to purchase the
107+
respective packages.
108+
{{< /comment >}}
109+
110+
#### Setup
111+
112+
1. Obtain a zip package of the ArangoDB Platform for the offline installation.
113+
It includes helm charts, manifests, and blobs of the container image layers.
114+
You also receive a package configuration file from the ArangoDB team.
115+
116+
2. Install the certificate manager. You can check <https://github.com/cert-manager/cert-manager>
117+
for the available releases.
118+
119+
```sh
120+
VERSION_CERT='1.18.2' # Use a newer version if available
121+
helm repo add jetstack https://charts.jetstack.io
122+
helm repo update
123+
124+
helm upgrade --install cert-manager \
125+
--namespace cert-manager --create-namespace \
126+
--version "v${VERSION_CERT}" \
127+
jetstack/cert-manager \
128+
--set crds.enabled=true
129+
```
130+
131+
3. Install the ArangoDB operator for Kubernetes `kube-arangodb` with helm,
132+
with options to enable webhooks, certificates, and the gateway feature.
133+
134+
```sh
135+
VERSION_OPERATOR='1.2.50' # Use a newer version if available
136+
137+
helm upgrade --install operator \
138+
--namespace arangodb --create-namespace \
139+
"https://github.com/arangodb/kube-arangodb/releases/download/${VERSION_OPERATOR}/kube-arangodb-${VERSION_OPERATOR}.tgz" \
140+
--set "webhooks.enabled=true" \
141+
--set "certificate.enabled=true" \
142+
--set "operator.args[0]=--deployment.feature.gateway=true" \
143+
--set "operator.architectures={amd64}" # or {arm64} for ARM-based CPUs
144+
```
145+
146+
4. Create an `ArangoDeployment` specification for the ArangoDB Core. See the
147+
[ArangoDeployment Custom Resource Overview](https://arangodb.github.io/kube-arangodb/docs/deployment-resource-reference.html)
148+
and the linked reference.
149+
150+
You need to enable the gateway feature by setting `spec.gateway.enabled` and
151+
`spec.gateway.dynamic` to `true` in the specification:
152+
153+
```yaml
154+
apiVersion: "database.arangodb.com/v1"
155+
kind: "ArangoDeployment"
156+
metadata:
157+
name: "platform-example"
158+
spec:
159+
gateway:
160+
enabled: true
161+
dynamic: true
162+
# ...
163+
```
164+
165+
5. Download the ArangoDB Platform CLI tool `arangodb_operator_platform` from
166+
<https://github.com/arangodb/kube-arangodb/releases>.
167+
It is available for Linux and macOS, for the x86-64 as well as 64-bit ARM
168+
architecture (e.g. `arangodb_operator_platform_linux_amd64`).
169+
170+
It is recommended to rename the downloaded executable to
171+
`arangodb_operator_platform` and add it to the `PATH` environment variable
172+
to make it available as a command in the system.
173+
174+
The Platform CLI tool simplifies the further setup and later management of
175+
the Platform's Kubernetes services.
176+
177+
6. Import the zip package of the ArangoDB Platform into the container registry.
178+
Replace `platform.zip` with the file path of the offline installation package.
179+
Replace `gcr.io/my-reg` with the address of your registry.
180+
181+
```sh
182+
arangodb_operator_platform package import \
183+
--registry-docker-credentials \
184+
gcr.io/my-reg \
185+
./platform.zip \
186+
platform.imported.yaml
187+
```
188+
189+
7. Install the package using the package configuration you received from the
190+
ArangoDB team (`platform.yaml`) and the configuration generated by the
191+
previous command (`platform.imported.yaml`). These configurations are merged,
192+
allowing for targeted upgrades and user-defined overrides.
193+
194+
The package installation creates and enables various services, including
195+
the unified web interface of the Platform.
196+
197+
```sh
198+
arangodb_operator_platform --context arangodb package install \
199+
--platform.name platform-example \
200+
./platform.yaml \
201+
./platform.imported.yaml
202+
```
203+
204+
## Interfaces
205+
206+
The ArangoDB Platform uses a gateway to make all its services available via a
207+
single port at the external address of the deployment. For a local deployment,
208+
the base URL is `https://127.0.0.1:8529`.
209+
210+
### Unified web interface
211+
212+
You can access the ArangoDB Platform web interface with a browser by appending
213+
`/ui/` to the base URL, e.g. `https://127.0.0.1:8529/ui/`.
214+
215+
### ArangoDB Core
216+
217+
The HTTP API of the ArangoDB Core database system is available at the base URL.
218+
For example, the URL of the Cursor API for submitting AQL queries (against the `_system` database) is
219+
`https://127.0.0.1:8529/_db/_system/_api/cursor`.

site/content/3.13/components/tools/arangodb-shell/details.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,8 +26,8 @@ use the load command:
2626
require("internal").load("/tmp/test.js")
2727
```
2828

29-
You can exit arangosh using the key combination `<CTRL> + D` or by
30-
typing `quit<ENTER>`.
29+
You can exit arangosh using the key combination {{< kbd "Ctrl D" >}} or by
30+
typing `quit` and hitting {{< kbd "Return" >}}.
3131

3232
## Shell Output
3333

site/content/3.13/components/tools/arangodb-shell/examples.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -81,5 +81,5 @@ Calling it displays helpful information.
8181

8282
_arangosh_ also provides auto-completion. Additional information on available
8383
commands and methods is thus provided by typing the first few letters of a
84-
variable and then pressing the tab key. It is recommend to try this with entering
85-
`db.` (without pressing return) and then pressing tab.
84+
variable and then pressing the {{< kbd "Tab" >}} key. It is recommend to try this with entering
85+
`db.` (without pressing {{< kbd "Return" >}}) and then pressing {{< kbd "Tab" >}}.

site/content/3.13/components/web-interface/queries.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -84,18 +84,18 @@ in the toolbar or via shortcut (see below).
8484

8585
### AQL Editor Shortcuts
8686

87-
| Key combination | Action |
88-
|:----------------|:-------|
89-
| `Ctrl`/`Cmd` + `Return` | Execute query
90-
| `Ctrl`/`Cmd` + `Alt` + `Return` | Execute selected query
91-
| `Ctrl`/`Cmd` + `Shift` + `Return` | Explain query
92-
| `Ctrl`/`Cmd` + `Shift` + `S` | Save query
93-
| `Ctrl`/`Cmd` + `Shift` + `C` | Toggle comments
94-
| `Ctrl`/`Cmd` + `Z` | Undo last change
95-
| `Ctrl`/`Cmd` + `Shift` + `Z` | Redo last change
96-
| `Shift` + `Alt` + `Up` | Increase font size
97-
| `Shift` + `Alt` + `Down` | Decrease font size
98-
| `Ctrl` + `Space` | Open up the spotlight search
87+
| Key combination (regular) | (Apple / macOS) | Action
88+
|:--------------------------------|:-------------------------------|:-------------
89+
| {{< kbd "Ctrl Return" >}} | {{< kbd "Cmd Return" >}} | Execute query
90+
| {{< kbd "Ctrl Alt Return" >}} | {{< kbd "Cmd Alt Return" >}} | Execute selected query
91+
| {{< kbd "Ctrl Shift Return" >}} | {{< kbd "Cmd Shift Return" >}} | Explain query
92+
| {{< kbd "Ctrl Shift S" >}} | {{< kbd "Cmd Shift S" >}} | Save query
93+
| {{< kbd "Ctrl Shift C" >}} | {{< kbd "Cmd Shift C" >}} | Toggle comments
94+
| {{< kbd "Ctrl Z" >}} | {{< kbd "Cmd Z" >}} | Undo last change
95+
| {{< kbd "Ctrl Shift Z" >}} | {{< kbd "Cmd Shift Z" >}} | Redo last change
96+
| {{< kbd "Shift Alt Up" >}} | {{< kbd "Shift Alt Up" >}} | Increase font size
97+
| {{< kbd "Shift Alt Down" >}} | {{< kbd "Shift Alt Down" >}} | Decrease font size
98+
| {{< kbd "Ctrl Space" >}} | {{< kbd "Ctrl Space" >}} | Open up the spotlight search
9999

100100
## Running Queries
101101

0 commit comments

Comments
 (0)