Skip to content

release: 0.1.0-alpha.1 #48

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 228 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
228 commits
Select commit Hold shift + click to select a range
c3ddf26
feat: add integration for the api
VinciGit00 Oct 31, 2024
d804679
add endpoint connection for feedback
VinciGit00 Nov 1, 2024
b136ee5
add tests and workflows
VinciGit00 Nov 1, 2024
34591b2
tests
VinciGit00 Nov 1, 2024
4921a4f
tests
VinciGit00 Nov 1, 2024
49b2e18
add feedback
VinciGit00 Nov 2, 2024
db6cbd9
removed .env
VinciGit00 Nov 2, 2024
908e67f
feat: refactoring of the folders
VinciGit00 Nov 4, 2024
1252494
add new import
VinciGit00 Nov 5, 2024
5cdc12c
fix import + pyproject.toml
lurenss Nov 5, 2024
2f57a07
Update pyproject.toml
lurenss Nov 5, 2024
a325a81
add readme
lurenss Nov 5, 2024
d874b16
Merge branch 'main' of https://github.com/ScrapeGraphAI/scrapegraph-py
lurenss Nov 5, 2024
b9a17d5
feat: add integration for local_scraper
VinciGit00 Nov 10, 2024
a389463
add example and tests
VinciGit00 Nov 11, 2024
93198c5
Rename readme.md to README.md
lurenss Nov 13, 2024
3d08e4e
feat: new release
VinciGit00 Nov 14, 2024
06f84c6
feat: add requirement files
VinciGit00 Nov 14, 2024
35a7a12
add refactoring of the library
VinciGit00 Nov 18, 2024
643ec0b
add: added .gitignore
DPende Nov 18, 2024
a1fae22
add: added .env file example
DPende Nov 18, 2024
97b8ff7
chore: added more information about the package
DPende Nov 18, 2024
742028f
updated the readme file
DPende Nov 18, 2024
aa6a483
refactor: improved code structure
DPende Nov 18, 2024
0214a29
add: added "smartscraper" and "smartscraper info" functionality
DPende Nov 18, 2024
cad027f
feat: add client integration
VinciGit00 Nov 19, 2024
d486a7a
feat: add docstring
VinciGit00 Nov 20, 2024
96b431d
Merge pull request #1 from ScrapeGraphAI/py-development
VinciGit00 Nov 20, 2024
ce02854
feat: refctoring of the folder
VinciGit00 Nov 20, 2024
4effb03
feat: add scrapegraphai api integration
VinciGit00 Nov 20, 2024
9edfc67
feat: removed local scraper
VinciGit00 Nov 20, 2024
fca340a
Update README.md
lurenss Nov 22, 2024
12f4fd3
Update README.md
lurenss Nov 22, 2024
c0f3bbf
fix: semantic release
lurenss Nov 22, 2024
97d9977
fix: semanti release 2
lurenss Nov 22, 2024
30ff13a
feat: semantic relaase
lurenss Nov 22, 2024
6320819
feat: test semantic release
lurenss Nov 22, 2024
3e611f2
feat: test semantic release
lurenss Nov 22, 2024
e5e4908
feat: semantic release
lurenss Nov 22, 2024
d953723
feat: try semantic release
lurenss Nov 22, 2024
19eda59
feat: test semantic release
lurenss Nov 22, 2024
63d3a36
feat: test semantic release
lurenss Nov 22, 2024
edd23d9
feat: semantic release
lurenss Nov 22, 2024
595c3c6
feat: maybe final release?
lurenss Nov 22, 2024
6df4b18
feat: semantic release
lurenss Nov 22, 2024
9871ff8
feat: check
lurenss Nov 22, 2024
8ce3ccd
feat: final release maybe semantic?
lurenss Nov 22, 2024
3bb66c4
feat: test
lurenss Nov 22, 2024
d81ab09
feat: fix
lurenss Nov 22, 2024
40fafb3
add: added functions examples
DPende Nov 23, 2024
d39f14e
refactor: renamed functions
DPende Nov 23, 2024
2e9d93d
chore: added dotenv pakage dependency
DPende Nov 23, 2024
c14eb8e
add new example on readme
VinciGit00 Nov 23, 2024
6d2ac47
Merge pull request #2 from ScrapeGraphAI/js-sdk-dev
VinciGit00 Nov 25, 2024
01ca238
refactor: code refactoring
DPende Nov 25, 2024
96649f0
add: implemented error handling
DPende Nov 25, 2024
164131a
refactor: code refactoring
DPende Nov 25, 2024
4579cbe
add: added repo info
DPende Nov 25, 2024
0669f52
refactor: update readme
DPende Nov 25, 2024
731a11a
Merge pull request #4 from ScrapeGraphAI/refactoring-js-sdk
VinciGit00 Nov 27, 2024
b6db205
chore: fix semantic release, migrate to uv
f-aguzzi Nov 27, 2024
c253363
feat: enhaced python sdk
PeriniM Nov 28, 2024
28dba7f
ci(release): 1.1.0 [skip ci]
semantic-release-bot Nov 28, 2024
5ea9cac
chore: update workflow scripts
f-aguzzi Nov 28, 2024
bd64d46
Merge branch 'enhancing-python-sdk' into main
VinciGit00 Nov 28, 2024
aa27aa5
Merge branch 'main' into error-management-js
DPende Nov 28, 2024
f688bdc
chore: set up CI scripts
f-aguzzi Nov 28, 2024
e6d07c0
ci(release): 1.2.0 [skip ci]
semantic-release-bot Nov 28, 2024
5913d5f
chore: fix pylint scripts
f-aguzzi Nov 28, 2024
a9c1fa5
docs: improved examples
PeriniM Nov 28, 2024
c16705b
docs: updated precommit and installation guide
PeriniM Nov 28, 2024
ee9efa6
docs: updated readme
PeriniM Nov 28, 2024
12428e5
Merge pull request #6 from ScrapeGraphAI/pre/beta
PeriniM Nov 28, 2024
6752c43
removed unued import
VinciGit00 Nov 28, 2024
3c2178e
fix: readme js sdk
lurenss Nov 28, 2024
9e9e138
chore: changed pakage name
DPende Nov 28, 2024
88a2f50
fix: removed wrong information
DPende Nov 28, 2024
ce53675
Merge pull request #3 from ScrapeGraphAI/error-management-js
DPende Nov 28, 2024
3c9f76d
Merge pull request #7 from ScrapeGraphAI/js-readme-standardization
DPende Nov 29, 2024
b5f2d4c
ci(release): 1.2.1 [skip ci]
semantic-release-bot Nov 29, 2024
d737996
Update package.json
VinciGit00 Nov 29, 2024
46ebd9d
fix: add enw timeout
VinciGit00 Nov 29, 2024
d6e7f40
ci(release): 1.2.2 [skip ci]
semantic-release-bot Nov 29, 2024
a2b57c7
refactor: code refactoring
DPende Nov 29, 2024
1299173
fix: the "workspace" key has been removed because it was conflicting …
DPende Nov 29, 2024
ee5738b
chore: added Zod package dependency
DPende Nov 29, 2024
cf2f28f
docs: added an example of the smartScraper functionality using a schema
DPende Nov 29, 2024
10a1a5a
feat: implemented support for requests with schema
DPende Nov 29, 2024
baf933b
feat: added example of the smartScraper function using a schema
DPende Nov 29, 2024
13cf1e5
chore: set up eslint and prettier for code linting and formatting
DPende Nov 29, 2024
6a351f3
feat: add integration for env variables
VinciGit00 Nov 30, 2024
34777af
ci(release): 1.3.0 [skip ci]
semantic-release-bot Nov 30, 2024
5903759
Merge pull request #8 from ScrapeGraphAI/js-schema-implementation
DPende Nov 30, 2024
d5ce218
ci(release): 1.4.0 [skip ci]
semantic-release-bot Nov 30, 2024
38e0862
Merge branch 'main' into js-eslint-prettier-configuration
DPende Nov 30, 2024
c086da9
Merge pull request #9 from ScrapeGraphAI/js-eslint-prettier-configura…
DPende Nov 30, 2024
690e87b
fix: sync client
VinciGit00 Dec 2, 2024
bc5c6ae
ci(release): 1.4.1 [skip ci]
semantic-release-bot Dec 2, 2024
589aa49
fix: timeout
VinciGit00 Dec 2, 2024
fb6a079
ci(release): 1.4.2 [skip ci]
semantic-release-bot Dec 2, 2024
dbd2f6a
Merge pull request #10 from ScrapeGraphAI/main
PeriniM Dec 3, 2024
83eac53
chore: improved url validation
PeriniM Dec 3, 2024
8250818
fix: updated comment
PeriniM Dec 3, 2024
cd1169b
ci(release): 1.4.3-beta.1 [skip ci]
semantic-release-bot Dec 3, 2024
f8c3a89
Merge pull request #11 from ScrapeGraphAI/pre/beta
PeriniM Dec 3, 2024
96f1c0b
ci(release): 1.4.3 [skip ci]
semantic-release-bot Dec 3, 2024
2791691
feat: splitted files
VinciGit00 Dec 4, 2024
acf93c0
Merge branch 'main' of https://github.com/ScrapeGraphAI/scrapegraph-sdk
VinciGit00 Dec 4, 2024
c6b47ad
ci(release): 1.5.0 [skip ci]
semantic-release-bot Dec 4, 2024
dc9d63c
add async schema
VinciGit00 Dec 4, 2024
c7506ba
Merge branch 'main' of https://github.com/ScrapeGraphAI/scrapegraph-sdk
VinciGit00 Dec 4, 2024
4740c58
add tests
VinciGit00 Dec 4, 2024
9712d4c
fix: logger working properly now
PeriniM Dec 5, 2024
8ab6147
ci(release): 1.4.3-beta.2 [skip ci]
semantic-release-bot Dec 5, 2024
2643f11
fix: updated env variable loading
PeriniM Dec 5, 2024
d3c352b
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/scrapegra…
PeriniM Dec 5, 2024
1bc26c7
ci(release): 1.4.3-beta.3 [skip ci]
semantic-release-bot Dec 5, 2024
9e1e496
feat: changed SyncClient to Client
PeriniM Dec 5, 2024
78d5eaf
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/scrapegra…
PeriniM Dec 5, 2024
8900f7b
ci(release): 1.5.0-beta.1 [skip ci]
semantic-release-bot Dec 5, 2024
c9f108c
Merge branch 'main' into pre/beta
PeriniM Dec 5, 2024
74e7793
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/scrapegra…
PeriniM Dec 5, 2024
636db26
ci(release): 1.6.0-beta.1 [skip ci]
semantic-release-bot Dec 5, 2024
6f43545
Merge pull request #12 from ScrapeGraphAI/pre/beta
PeriniM Dec 5, 2024
e9c852c
ci(release): 1.6.0 [skip ci]
semantic-release-bot Dec 5, 2024
ae1cde3
Merge pull request #13 from ScrapeGraphAI/main
PeriniM Dec 5, 2024
6296510
feat: add markdownify and localscraper
PeriniM Dec 5, 2024
5e65800
ci(release): 1.7.0-beta.1 [skip ci]
semantic-release-bot Dec 5, 2024
d789f59
Merge pull request #14 from ScrapeGraphAI/pre/beta
PeriniM Dec 5, 2024
0acc62e
ci(release): 1.7.0 [skip ci]
semantic-release-bot Dec 5, 2024
8c841b3
Merge pull request #15 from ScrapeGraphAI/main
PeriniM Dec 5, 2024
50fdf92
docs: improved main readme
PeriniM Dec 5, 2024
514ba6f
Update README.md
VinciGit00 Dec 6, 2024
239d27a
feat: add markdownify functionality
DPende Dec 7, 2024
365378a
fix: fixed schema example
DPende Dec 7, 2024
bc08dcb
fix: fixed configuration for ignored files
DPende Dec 7, 2024
5c43dc4
style: Improve formatting and style
DPende Dec 7, 2024
e3c14e1
Merge pull request #16 from ScrapeGraphAI/js-markdownify-implementation
VinciGit00 Dec 8, 2024
d338747
Merge pull request #17 from ScrapeGraphAI/js-code-refactoring
VinciGit00 Dec 8, 2024
7593ed5
ci(release): 1.8.0 [skip ci]
semantic-release-bot Dec 8, 2024
8701eb2
feat: add localScraper functionality
DPende Dec 8, 2024
671161d
style: Improve formatting and style
DPende Dec 8, 2024
81d8362
add new version
VinciGit00 Dec 9, 2024
9d770a8
Merge branch 'main' of https://github.com/ScrapeGraphAI/scrapegraph-sdk
VinciGit00 Dec 9, 2024
0b052eb
add new workflow for releasing
VinciGit00 Dec 10, 2024
cca2d8c
Merge pull request #19 from ScrapeGraphAI/main
VinciGit00 Dec 10, 2024
89d30ff
Merge pull request #18 from ScrapeGraphAI/js-localScraper-implementation
VinciGit00 Dec 10, 2024
0b972c6
fix: minor fix version
VinciGit00 Dec 10, 2024
09257e0
fix: add revert
VinciGit00 Dec 10, 2024
24366b0
fix: python version
VinciGit00 Dec 10, 2024
d88a3ac
feat: revert to old release
VinciGit00 Dec 10, 2024
e719881
fix: .toml file
VinciGit00 Dec 10, 2024
2440f7f
fix: pyproject
VinciGit00 Dec 10, 2024
236d55b
ci(release): 1.9.0-beta.1 [skip ci]
semantic-release-bot Dec 10, 2024
77b67f6
fix: add new python compatibility
VinciGit00 Dec 10, 2024
59611f6
ci(release): 1.9.0-beta.2 [skip ci]
semantic-release-bot Dec 10, 2024
26d3a75
fix: come back to py 3.10
VinciGit00 Dec 10, 2024
a1bf542
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/scrapegra…
VinciGit00 Dec 10, 2024
cbf2da4
ci(release): 1.9.0-beta.3 [skip ci]
semantic-release-bot Dec 10, 2024
7b88876
docs: added api reference
PeriniM Dec 16, 2024
6929a7a
docs: added api reference
PeriniM Dec 16, 2024
855c2e5
docs: api reference
PeriniM Dec 16, 2024
320de37
docs: github trending sdk
PeriniM Dec 17, 2024
c2fc1ef
docs: added open in colab badge
PeriniM Dec 17, 2024
7fad92c
docs: added zillow example
PeriniM Dec 18, 2024
3567034
chore: fix pyproject version
f-aguzzi Dec 18, 2024
f67769e
docs(cookbook): added two new examples
PeriniM Dec 18, 2024
479dbdb
docs: added langchain-scrapegraph examples
PeriniM Dec 19, 2024
8f3a87e
docs: added two langchain-scrapegraph examples
PeriniM Dec 19, 2024
ca8de3e
refactoring examples
VinciGit00 Dec 21, 2024
ec22ac8
refactoring images
VinciGit00 Dec 21, 2024
9f1e0cf
docs: added wired langgraph react agent
PeriniM Dec 21, 2024
e1bfd6a
docs: link typo
PeriniM Dec 21, 2024
e68c1bd
docs: added cookbook reference
PeriniM Dec 21, 2024
b353876
add examples
VinciGit00 Dec 21, 2024
a4fe204
Merge branch 'main' of https://github.com/ScrapeGraphAI/scrapegraph-sdk
VinciGit00 Dec 21, 2024
6e06afa
docs: research agent
PeriniM Dec 22, 2024
c02c411
feat: update doc readme
VinciGit00 Dec 23, 2024
c596c44
fix: houses examples and typos
lurenss Dec 27, 2024
1d0cb46
docs: updated new documentation urls
PeriniM Dec 27, 2024
dec1548
Update scrapegraph_llama_index.ipynb
VinciGit00 Dec 27, 2024
f860167
docs: fixed cookbook images and urls
PeriniM Dec 28, 2024
5fa2b42
docs: added two new examples
PeriniM Dec 29, 2024
cb05e8a
Update README.md
VinciGit00 Jan 3, 2025
62243f8
fix: improve api desc
PeriniM Jan 3, 2025
05d57ae
ci(release): 1.9.0-beta.4 [skip ci]
semantic-release-bot Jan 3, 2025
740933a
fix: updated hatchling version
PeriniM Jan 3, 2025
eb86328
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/scrapegra…
PeriniM Jan 3, 2025
d03b9bf
ci(release): 1.9.0-beta.5 [skip ci]
semantic-release-bot Jan 3, 2025
6de5eb2
docs: llama-index @VinciGit00
PeriniM Jan 3, 2025
945b876
feat: add time varying timeout
VinciGit00 Jan 4, 2025
433e7d0
Update uv.lock
VinciGit00 Jan 4, 2025
701a4c1
chore: fix _make_request not using it
PeriniM Jan 8, 2025
49b8e4b
fix: make timeout optional
PeriniM Jan 8, 2025
b7330cb
Merge pull request #25 from ScrapeGraphAI/async-change
VinciGit00 Jan 8, 2025
87b9252
Merge pull request #21 from ScrapeGraphAI/pre/beta
VinciGit00 Jan 8, 2025
c898e99
ci(release): 1.9.0-beta.6 [skip ci]
semantic-release-bot Jan 8, 2025
087db73
ci(release): 1.9.0 [skip ci]
semantic-release-bot Jan 8, 2025
cb5450c
Create scrapegraph_langraph_tavily_my_sql.ipynb
VinciGit00 Jan 14, 2025
2543b5a
feat: add integration for sql
VinciGit00 Jan 14, 2025
f132a2d
Update scrapegraph_langgraph_tavily_my_sql.ipynb
VinciGit00 Jan 15, 2025
b052ddb
docs: added new image
PeriniM Jan 16, 2025
d054092
Merge pull request #27 from ScrapeGraphAI/sql-integration
PeriniM Jan 16, 2025
7525843
ci(release): 1.10.0 [skip ci]
semantic-release-bot Jan 16, 2025
e8aed70
fix: pyproject.toml
VinciGit00 Jan 22, 2025
c6e6c6e
fix: pyproject.toml
VinciGit00 Jan 22, 2025
9131f14
ci(release): 1.10.1 [skip ci]
semantic-release-bot Jan 22, 2025
5d6a9ee
fix: pyproject
VinciGit00 Jan 22, 2025
8d3c542
Merge branch 'main' of https://github.com/ScrapeGraphAI/scrapegraph-sdk
VinciGit00 Jan 22, 2025
d1e4e7d
ci(release): 1.10.2 [skip ci]
semantic-release-bot Jan 22, 2025
503dbd1
feat: merged localscraper into smartscraper
PeriniM Feb 1, 2025
bb851d7
feat: add optional headers to request
PeriniM Feb 1, 2025
9149ce8
chore(tests): updated tests
PeriniM Feb 1, 2025
2e04e5a
feat: searchscraper
PeriniM Feb 1, 2025
8e00846
chore: refactor examples
PeriniM Feb 3, 2025
bfdbea0
feat: updated readmes
PeriniM Feb 3, 2025
bcb9b0b
feat: modified icons
PeriniM Feb 3, 2025
c435542
Merge pull request #30 from ScrapeGraphAI/feat-searchscraper
PeriniM Feb 3, 2025
2c1875b
ci(release): 1.9.0-beta.7 [skip ci]
semantic-release-bot Feb 3, 2025
49271b0
Merge branch 'main' into pre/beta
PeriniM Feb 3, 2025
f32d182
Merge pull request #31 from ScrapeGraphAI/pre/beta
PeriniM Feb 3, 2025
2a62b40
ci(release): 1.11.0-beta.1 [skip ci]
semantic-release-bot Feb 3, 2025
efc4799
ci(release): 1.11.0 [skip ci]
semantic-release-bot Feb 3, 2025
5d90227
Merge branch 'pre/beta' into main
PeriniM Feb 3, 2025
8e31b6a
Merge pull request #32 from ScrapeGraphAI/main
PeriniM Feb 3, 2025
b26b447
chore: sync repo
stainless-app[bot] Aug 3, 2025
1e22194
chore: update SDK settings
stainless-app[bot] Aug 3, 2025
d928748
release: 0.1.0-alpha.1
stainless-app[bot] Aug 4, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .devcontainer/devcontainer.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
// For format details, see https://aka.ms/devcontainer.json. For config options, see the
// README at: https://github.com/devcontainers/templates/tree/main/src/debian
{
"name": "Development",
"image": "mcr.microsoft.com/devcontainers/go:1.23-bookworm",
"postCreateCommand": "go mod tidy"
}
49 changes: 49 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
name: CI
on:
push:
branches-ignore:
- 'generated'
- 'codegen/**'
- 'integrated/**'
- 'stl-preview-head/**'
- 'stl-preview-base/**'
pull_request:
branches-ignore:
- 'stl-preview-head/**'
- 'stl-preview-base/**'

jobs:
lint:
timeout-minutes: 10
name: lint
runs-on: ${{ github.repository == 'stainless-sdks/scrapegraphai-sdk-go' && 'depot-ubuntu-24.04' || 'ubuntu-latest' }}
if: github.event_name == 'push' || github.event.pull_request.head.repo.fork

steps:
- uses: actions/checkout@v4

- name: Setup go
uses: actions/setup-go@v5
with:
go-version-file: ./go.mod

- name: Run lints
run: ./scripts/lint
test:
timeout-minutes: 10
name: test
runs-on: ${{ github.repository == 'stainless-sdks/scrapegraphai-sdk-go' && 'depot-ubuntu-24.04' || 'ubuntu-latest' }}
if: github.event_name == 'push' || github.event.pull_request.head.repo.fork
steps:
- uses: actions/checkout@v4

- name: Setup go
uses: actions/setup-go@v5
with:
go-version-file: ./go.mod

- name: Bootstrap
run: ./scripts/bootstrap

- name: Run tests
run: ./scripts/test
4 changes: 4 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
.prism.log
codegen.log
Brewfile.lock.json
.idea/
3 changes: 3 additions & 0 deletions .release-please-manifest.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
{
".": "0.1.0-alpha.1"
}
4 changes: 4 additions & 0 deletions .stats.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
configured_endpoints: 13
openapi_spec_url: https://storage.googleapis.com/stainless-sdk-openapi-specs/scrapegraphai%2Fscrapegraphai-sdk-1bb59000acb1297b8bbff37e8e34ed4751b9708a050695796e64ed3a8900ceef.yml
openapi_spec_hash: 141d244ff26ff28ab56901a19fb46347
config_hash: 841efa635faf188bb88c338627bf9658
1 change: 1 addition & 0 deletions Brewfile
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
brew "go"
144 changes: 144 additions & 0 deletions CHANGELOG.md

Large diffs are not rendered by default.

66 changes: 66 additions & 0 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
## Setting up the environment

To set up the repository, run:

```sh
$ ./scripts/bootstrap
$ ./scripts/lint
```

This will install all the required dependencies and build the SDK.

You can also [install go 1.18+ manually](https://go.dev/doc/install).

## Modifying/Adding code

Most of the SDK is generated code. Modifications to code will be persisted between generations, but may
result in merge conflicts between manual patches and changes from the generator. The generator will never
modify the contents of the `lib/` and `examples/` directories.

## Adding and running examples

All files in the `examples/` directory are not modified by the generator and can be freely edited or added to.

```go
# add an example to examples/<your-example>/main.go

package main

func main() {
// ...
}
```

```sh
$ go run ./examples/<your-example>
```

## Using the repository from source

To use a local version of this library from source in another project, edit the `go.mod` with a replace
directive. This can be done through the CLI with the following:

```sh
$ go mod edit -replace github.com/ScrapeGraphAI/scrapegraph-sdk=/path/to/scrapegraph-sdk
```

## Running tests

Most tests require you to [set up a mock server](https://github.com/stoplightio/prism) against the OpenAPI spec to run the tests.

```sh
# you will need npm installed
$ npx prism mock path/to/your/openapi.yml
```

```sh
$ ./scripts/test
```

## Formatting

This library uses the standard gofmt code formatter:

```sh
$ ./scripts/format
```
201 changes: 201 additions & 0 deletions LICENSE
Original file line number Diff line number Diff line change
@@ -0,0 +1,201 @@
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/

TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION

1. Definitions.

"License" shall mean the terms and conditions for use, reproduction,
and distribution as defined by Sections 1 through 9 of this document.

"Licensor" shall mean the copyright owner or entity authorized by
the copyright owner that is granting the License.

"Legal Entity" shall mean the union of the acting entity and all
other entities that control, are controlled by, or are under common
control with that entity. For the purposes of this definition,
"control" means (i) the power, direct or indirect, to cause the
direction or management of such entity, whether by contract or
otherwise, or (ii) ownership of fifty percent (50%) or more of the
outstanding shares, or (iii) beneficial ownership of such entity.

"You" (or "Your") shall mean an individual or Legal Entity
exercising permissions granted by this License.

"Source" form shall mean the preferred form for making modifications,
including but not limited to software source code, documentation
source, and configuration files.

"Object" form shall mean any form resulting from mechanical
transformation or translation of a Source form, including but
not limited to compiled object code, generated documentation,
and conversions to other media types.

"Work" shall mean the work of authorship, whether in Source or
Object form, made available under the License, as indicated by a
copyright notice that is included in or attached to the work
(an example is provided in the Appendix below).

"Derivative Works" shall mean any work, whether in Source or Object
form, that is based on (or derived from) the Work and for which the
editorial revisions, annotations, elaborations, or other modifications
represent, as a whole, an original work of authorship. For the purposes
of this License, Derivative Works shall not include works that remain
separable from, or merely link (or bind by name) to the interfaces of,
the Work and Derivative Works thereof.

"Contribution" shall mean any work of authorship, including
the original version of the Work and any modifications or additions
to that Work or Derivative Works thereof, that is intentionally
submitted to Licensor for inclusion in the Work by the copyright owner
or by an individual or Legal Entity authorized to submit on behalf of
the copyright owner. For the purposes of this definition, "submitted"
means any form of electronic, verbal, or written communication sent
to the Licensor or its representatives, including but not limited to
communication on electronic mailing lists, source code control systems,
and issue tracking systems that are managed by, or on behalf of, the
Licensor for the purpose of discussing and improving the Work, but
excluding communication that is conspicuously marked or otherwise
designated in writing by the copyright owner as "Not a Contribution."

"Contributor" shall mean Licensor and any individual or Legal Entity
on behalf of whom a Contribution has been received by Licensor and
subsequently incorporated within the Work.

2. Grant of Copyright License. Subject to the terms and conditions of
this License, each Contributor hereby grants to You a perpetual,
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
copyright license to reproduce, prepare Derivative Works of,
publicly display, publicly perform, sublicense, and distribute the
Work and such Derivative Works in Source or Object form.

3. Grant of Patent License. Subject to the terms and conditions of
this License, each Contributor hereby grants to You a perpetual,
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
(except as stated in this section) patent license to make, have made,
use, offer to sell, sell, import, and otherwise transfer the Work,
where such license applies only to those patent claims licensable
by such Contributor that are necessarily infringed by their
Contribution(s) alone or by combination of their Contribution(s)
with the Work to which such Contribution(s) was submitted. If You
institute patent litigation against any entity (including a
cross-claim or counterclaim in a lawsuit) alleging that the Work
or a Contribution incorporated within the Work constitutes direct
or contributory patent infringement, then any patent licenses
granted to You under this License for that Work shall terminate
as of the date such litigation is filed.

4. Redistribution. You may reproduce and distribute copies of the
Work or Derivative Works thereof in any medium, with or without
modifications, and in Source or Object form, provided that You
meet the following conditions:

(a) You must give any other recipients of the Work or
Derivative Works a copy of this License; and

(b) You must cause any modified files to carry prominent notices
stating that You changed the files; and

(c) You must retain, in the Source form of any Derivative Works
that You distribute, all copyright, patent, trademark, and
attribution notices from the Source form of the Work,
excluding those notices that do not pertain to any part of
the Derivative Works; and

(d) If the Work includes a "NOTICE" text file as part of its
distribution, then any Derivative Works that You distribute must
include a readable copy of the attribution notices contained
within such NOTICE file, excluding those notices that do not
pertain to any part of the Derivative Works, in at least one
of the following places: within a NOTICE text file distributed
as part of the Derivative Works; within the Source form or
documentation, if provided along with the Derivative Works; or,
within a display generated by the Derivative Works, if and
wherever such third-party notices normally appear. The contents
of the NOTICE file are for informational purposes only and
do not modify the License. You may add Your own attribution
notices within Derivative Works that You distribute, alongside
or as an addendum to the NOTICE text from the Work, provided
that such additional attribution notices cannot be construed
as modifying the License.

You may add Your own copyright statement to Your modifications and
may provide additional or different license terms and conditions
for use, reproduction, or distribution of Your modifications, or
for any such Derivative Works as a whole, provided Your use,
reproduction, and distribution of the Work otherwise complies with
the conditions stated in this License.

5. Submission of Contributions. Unless You explicitly state otherwise,
any Contribution intentionally submitted for inclusion in the Work
by You to the Licensor shall be under the terms and conditions of
this License, without any additional terms or conditions.
Notwithstanding the above, nothing herein shall supersede or modify
the terms of any separate license agreement you may have executed
with Licensor regarding such Contributions.

6. Trademarks. This License does not grant permission to use the trade
names, trademarks, service marks, or product names of the Licensor,
except as required for reasonable and customary use in describing the
origin of the Work and reproducing the content of the NOTICE file.

7. Disclaimer of Warranty. Unless required by applicable law or
agreed to in writing, Licensor provides the Work (and each
Contributor provides its Contributions) on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied, including, without limitation, any warranties or conditions
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
PARTICULAR PURPOSE. You are solely responsible for determining the
appropriateness of using or redistributing the Work and assume any
risks associated with Your exercise of permissions under this License.

8. Limitation of Liability. In no event and under no legal theory,
whether in tort (including negligence), contract, or otherwise,
unless required by applicable law (such as deliberate and grossly
negligent acts) or agreed to in writing, shall any Contributor be
liable to You for damages, including any direct, indirect, special,
incidental, or consequential damages of any character arising as a
result of this License or out of the use or inability to use the
Work (including but not limited to damages for loss of goodwill,
work stoppage, computer failure or malfunction, or any and all
other commercial damages or losses), even if such Contributor
has been advised of the possibility of such damages.

9. Accepting Warranty or Additional Liability. While redistributing
the Work or Derivative Works thereof, You may choose to offer,
and charge a fee for, acceptance of support, warranty, indemnity,
or other liability obligations and/or rights consistent with this
License. However, in accepting such obligations, You may act only
on Your own behalf and on Your sole responsibility, not on behalf
of any other Contributor, and only if You agree to indemnify,
defend, and hold each Contributor harmless for any liability
incurred by, or claims asserted against, such Contributor by reason
of your accepting any such warranty or additional liability.

END OF TERMS AND CONDITIONS

APPENDIX: How to apply the Apache License to your work.

To apply the Apache License to your work, attach the following
boilerplate notice, with the fields enclosed by brackets "[]"
replaced with your own identifying information. (Don't include
the brackets!) The text should be enclosed in the appropriate
comment syntax for the file format. We also recommend that a
file or class name and description of purpose be included on the
same "printed page" as the copyright notice for easier
identification within third-party archives.

Copyright 2025 Scrapegraphai SDK

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
Loading