You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There's probably no one-size-fits-all approach here, so I'm looking for some general guidance and things you would consider in answering this question.
Should you store the actual text of a document in the graph database?
This guide suggests that each chunk has a text property alongside and a property to store the embedding.
On the other hand, this blog post seems to suggest that no actual text is stored inside the graph database:
Each chunk is represented as a chunk node in Neo4j with properties like document position, and offset and length of text.
I'm expecting 50-100GB of data and so it would seem redundant to have the chunks of text inside the graph database alongside the full document inside classic storage, like S3.
In what cases is there a really significant benefit to having the actual text available directly in the graph database?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
There's probably no one-size-fits-all approach here, so I'm looking for some general guidance and things you would consider in answering this question.
Should you store the actual text of a document in the graph database?
This guide suggests that each chunk has a
text
property alongside and a property to store the embedding.On the other hand, this blog post seems to suggest that no actual text is stored inside the graph database:
I'm expecting 50-100GB of data and so it would seem redundant to have the chunks of text inside the graph database alongside the full document inside classic storage, like S3.
In what cases is there a really significant benefit to having the actual text available directly in the graph database?
Beta Was this translation helpful? Give feedback.
All reactions