Skip to content

Commit 67de52a

Browse files
authored
Merge pull request #883 from ScrapeGraphAI/main
Alignment
2 parents 04bd3f8 + aa6a76e commit 67de52a

File tree

3 files changed

+53
-13
lines changed

3 files changed

+53
-13
lines changed

CHANGELOG.md

+26
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,29 @@
1+
## [1.36.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.35.0...v1.36.0) (2025-01-12)
2+
3+
4+
### Features
5+
6+
* add example of collab ([1fad118](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/1fad1181a6b2d654c4eb996348907940b1d8a7af))
7+
8+
9+
### Bug Fixes
10+
11+
* ollama tokenizer limited to 1024 tokens + ollama structured output + fix browser backend ([ad693b2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/ad693b2bb201b4d9280139e70a2930358e779366))
12+
* updated ollama structured output ([3b95911](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/3b9591156d96ac7266055703e7ffb354e90b01f0))
13+
14+
15+
### Docs
16+
17+
* ✨ code quality badge update ([02022cc](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/02022cc5db39fede1a1d920d17e18ba0d05328ba))
18+
* improved readme + fix csv scraper imports ([14b4b19](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/14b4b19f60e33c855bee4eea0a1a6fcc01a98c1a))
19+
* refactoring of the doc ([5ca325c](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/5ca325c7257b71fc4cd12ee26bde3e992ade5756))
20+
21+
22+
### CI
23+
24+
* **release:** 1.35.1-beta.1 [skip ci] ([1d17d92](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/1d17d92c1f4a29da9d9333dd9a06ea9baf043192))
25+
* **release:** 1.36.0-beta.1 [skip ci] ([04bd3f8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/04bd3f8e572fc79e3e3ad439cd3bb72a409edf91))
26+
127
## [1.36.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.35.1-beta.1...v1.36.0-beta.1) (2025-01-12)
228

329

README.md

+26-12
Original file line numberDiff line numberDiff line change
@@ -51,8 +51,8 @@ from scrapegraphai.graphs import SmartScraperGraph
5151
# Define the configuration for the scraping pipeline
5252
graph_config = {
5353
"llm": {
54-
"api_key": "YOUR_OPENAI_API_KEY",
55-
"model": "openai/gpt-4o-mini",
54+
"model": "ollama/llama3.2",
55+
"model_tokens": 8192
5656
},
5757
"verbose": True,
5858
"headless": False,
@@ -72,6 +72,20 @@ import json
7272
print(json.dumps(result, indent=4))
7373
```
7474

75+
> [!NOTE]
76+
> For OpenAI and other models you just need to change the llm config!
77+
> ```python
78+
>graph_config = {
79+
> "llm": {
80+
> "api_key": "YOUR_OPENAI_API_KEY",
81+
> "model": "openai/gpt-4o-mini",
82+
> },
83+
> "verbose": True,
84+
> "headless": False,
85+
>}
86+
>```
87+
88+
7589
The output will be a dictionary like the following:
7690
7791
```python
@@ -126,6 +140,16 @@ Remember to have [Ollama](https://ollama.com/) installed and download the models
126140
The documentation for ScrapeGraphAI can be found [here](https://scrapegraph-ai.readthedocs.io/en/latest/).
127141
Check out also the Docusaurus [here](https://docs-oss.scrapegraphai.com/).
128142

143+
## 🤝 Contributing
144+
145+
Feel free to contribute and join our Discord server to discuss with us improvements and give us suggestions!
146+
147+
Please see the [contributing guidelines](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/CONTRIBUTING.md).
148+
149+
[![My Skills](https://skillicons.dev/icons?i=discord)](https://discord.gg/uJN7TYcpNa)
150+
[![My Skills](https://skillicons.dev/icons?i=linkedin)](https://www.linkedin.com/company/scrapegraphai/)
151+
[![My Skills](https://skillicons.dev/icons?i=twitter)](https://twitter.com/scrapegraphai)
152+
129153
## 🔗 ScrapeGraph API & SDKs
130154
If you are looking for a quick solution to integrate ScrapeGraph in your system, check out our powerful API [here!](https://dashboard.scrapegraphai.com/login)
131155

@@ -158,16 +182,6 @@ The Official API Documentation can be found [here](https://docs.scrapegraphai.co
158182
</a>
159183
</div>
160184

161-
## 🤝 Contributing
162-
163-
Feel free to contribute and join our Discord server to discuss with us improvements and give us suggestions!
164-
165-
Please see the [contributing guidelines](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/CONTRIBUTING.md).
166-
167-
[![My Skills](https://skillicons.dev/icons?i=discord)](https://discord.gg/uJN7TYcpNa)
168-
[![My Skills](https://skillicons.dev/icons?i=linkedin)](https://www.linkedin.com/company/scrapegraphai/)
169-
[![My Skills](https://skillicons.dev/icons?i=twitter)](https://twitter.com/scrapegraphai)
170-
171185
## 📈 Telemetry
172186
We collect anonymous usage metrics to enhance our package's quality and user experience. The data helps us prioritize improvements and ensure compatibility. If you wish to opt-out, set the environment variable SCRAPEGRAPHAI_TELEMETRY_ENABLED=false. For more information, please refer to the documentation [here](https://scrapegraph-ai.readthedocs.io/en/latest/scrapers/telemetry.html).
173187

pyproject.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[project]
22
name = "scrapegraphai"
3-
version = "1.36.0b1"
3+
version = "1.36.0"
44

55

66
description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines."

0 commit comments

Comments
 (0)