Merge pull request #883 from ScrapeGraphAI/main

[VinciGit00]

Main differences:

[github-actions]

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

OpenSSF Scorecard

Package	Version	Score	Details
pip/myst-parser	>= 2.0.0	🟢 4.6	Details Check Score Reason Dangerous-Workflow 🟢 10 no dangerous workflow patterns detected Packaging ⚠️ -1 packaging workflow not detected Code-Review ⚠️ 2 Found 7/26 approved changesets -- score normalized to 2 Maintained 🟢 6 7 commit(s) and 1 issue activity found in the last 90 days -- score normalized to 6 Token-Permissions ⚠️ 0 detected GitHub workflow tokens with excessive permissions Binary-Artifacts 🟢 10 no binaries found in the repo Pinned-Dependencies ⚠️ 0 dependency not pinned by hash detected -- score normalized to 0 CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Fuzzing ⚠️ 0 project is not fuzzed License 🟢 10 license file detected Vulnerabilities 🟢 10 0 existing vulnerabilities detected Signed-Releases ⚠️ -1 no releases found Branch-Protection ⚠️ -1 internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration Security-Policy ⚠️ 0 security policy file not detected SAST ⚠️ 0 SAST tool is not run on all commits -- score normalized to 0
pip/sphinx	>= 7.1.2	🟢 5.4	Details Check Score Reason Maintained 🟢 10 30 commit(s) and 18 issue activity found in the last 90 days -- score normalized to 10 Code-Review ⚠️ 1 Found 3/29 approved changesets -- score normalized to 1 Dangerous-Workflow 🟢 10 no dangerous workflow patterns detected Packaging ⚠️ -1 packaging workflow not detected Token-Permissions 🟢 9 detected GitHub workflow tokens with excessive permissions CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Binary-Artifacts 🟢 10 no binaries found in the repo License 🟢 9 license file detected Signed-Releases ⚠️ -1 no releases found Branch-Protection 🟢 3 branch protection is not maximal on development and all release branches Pinned-Dependencies ⚠️ 0 dependency not pinned by hash detected -- score normalized to 0 Fuzzing ⚠️ 0 project is not fuzzed Security-Policy ⚠️ 0 security policy file not detected SAST ⚠️ 1 SAST tool is not run on all commits -- score normalized to 1 Vulnerabilities 🟢 8 2 existing vulnerabilities detected
pip/sphinx-autoapi	>= 3.0.0	🟢 4.6	Details Check Score Reason Maintained 🟢 10 17 commit(s) and 5 issue activity found in the last 90 days -- score normalized to 10 Dangerous-Workflow 🟢 10 no dangerous workflow patterns detected Code-Review ⚠️ 2 Found 7/30 approved changesets -- score normalized to 2 Token-Permissions ⚠️ 0 detected GitHub workflow tokens with excessive permissions Binary-Artifacts 🟢 10 no binaries found in the repo Pinned-Dependencies ⚠️ 0 dependency not pinned by hash detected -- score normalized to 0 CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Security-Policy ⚠️ 0 security policy file not detected Vulnerabilities 🟢 10 0 existing vulnerabilities detected License 🟢 10 license file detected Fuzzing ⚠️ 0 project is not fuzzed Signed-Releases ⚠️ 1 1 out of the last 5 releases have a total of 1 signed artifacts. Branch-Protection ⚠️ 0 branch protection not enabled on development/release branches Packaging 🟢 10 packaging workflow detected SAST ⚠️ 0 SAST tool is not run on all commits -- score normalized to 0
pip/sphinx-autodoc-typehints	>= 1.25.2	🟢 6.1	Details Check Score Reason Code-Review 🟢 4 Found 5/11 approved changesets -- score normalized to 4 Maintained 🟢 10 16 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10 Security-Policy 🟢 10 security policy file detected Dangerous-Workflow 🟢 10 no dangerous workflow patterns detected Binary-Artifacts 🟢 10 no binaries found in the repo Token-Permissions ⚠️ 0 detected GitHub workflow tokens with excessive permissions Pinned-Dependencies ⚠️ 0 dependency not pinned by hash detected -- score normalized to 0 CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Fuzzing ⚠️ 0 project is not fuzzed Vulnerabilities 🟢 10 0 existing vulnerabilities detected License 🟢 10 license file detected Signed-Releases ⚠️ -1 no releases found Packaging 🟢 10 packaging workflow detected Branch-Protection 🟢 5 branch protection is not maximal on development and all release branches SAST ⚠️ 0 SAST tool is not run on all commits -- score normalized to 0
pip/sphinx-copybutton	>= 0.5.2	🟢 3.3	Details Check Score Reason Code-Review 🟢 5 Found 8/16 approved changesets -- score normalized to 5 Binary-Artifacts 🟢 10 no binaries found in the repo Token-Permissions ⚠️ 0 detected GitHub workflow tokens with excessive permissions Dangerous-Workflow 🟢 10 no dangerous workflow patterns detected Maintained ⚠️ 0 0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0 CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Pinned-Dependencies ⚠️ 1 dependency not pinned by hash detected -- score normalized to 1 Fuzzing ⚠️ 0 project is not fuzzed License 🟢 10 license file detected Signed-Releases ⚠️ -1 no releases found Security-Policy ⚠️ 0 security policy file not detected Branch-Protection ⚠️ -1 internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration Packaging ⚠️ -1 packaging workflow not detected SAST ⚠️ 0 SAST tool is not run on all commits -- score normalized to 0 Vulnerabilities ⚠️ 0 10 existing vulnerabilities detected
pip/sphinx-design	>= 0.5.0	🟢 3.9	Details Check Score Reason Dangerous-Workflow 🟢 10 no dangerous workflow patterns detected Code-Review ⚠️ 2 Found 8/28 approved changesets -- score normalized to 2 Token-Permissions ⚠️ 0 detected GitHub workflow tokens with excessive permissions Packaging ⚠️ -1 packaging workflow not detected Maintained ⚠️ 0 0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0 Binary-Artifacts 🟢 10 no binaries found in the repo CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Fuzzing ⚠️ 0 project is not fuzzed License 🟢 10 license file detected Pinned-Dependencies ⚠️ 0 dependency not pinned by hash detected -- score normalized to 0 Signed-Releases ⚠️ -1 no releases found Branch-Protection ⚠️ -1 internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration Security-Policy ⚠️ 0 security policy file not detected Vulnerabilities 🟢 9 1 existing vulnerabilities detected SAST ⚠️ 0 SAST tool is not run on all commits -- score normalized to 0
pip/sphinx-rtd-theme	>= 1.3.0	🟢 4	Details Check Score Reason Packaging ⚠️ -1 packaging workflow not detected Maintained 🟢 10 4 commit(s) and 9 issue activity found in the last 90 days -- score normalized to 10 Code-Review 🟢 6 Found 20/30 approved changesets -- score normalized to 6 Token-Permissions ⚠️ -1 No tokens found Dangerous-Workflow ⚠️ -1 no workflows found Binary-Artifacts 🟢 10 no binaries found in the repo CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Security-Policy ⚠️ 0 security policy file not detected Fuzzing ⚠️ 0 project is not fuzzed License 🟢 10 license file detected Signed-Releases ⚠️ -1 no releases found Branch-Protection ⚠️ -1 internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration Pinned-Dependencies ⚠️ 0 dependency not pinned by hash detected -- score normalized to 0 SAST ⚠️ 0 SAST tool is not run on all commits -- score normalized to 0 Vulnerabilities ⚠️ 0 41 existing vulnerabilities detected
pip/duckduckgo-search	>= 7.2.1	🟢 4.4	Details Check Score Reason Packaging ⚠️ -1 packaging workflow not detected Maintained 🟢 10 30 commit(s) and 6 issue activity found in the last 90 days -- score normalized to 10 Code-Review ⚠️ 0 Found 0/22 approved changesets -- score normalized to 0 Binary-Artifacts 🟢 10 no binaries found in the repo Dangerous-Workflow 🟢 10 no dangerous workflow patterns detected Token-Permissions ⚠️ 0 detected GitHub workflow tokens with excessive permissions CII-Best-Practices ⚠️ 0 no effort to earn an OpenSSF best practices badge detected Pinned-Dependencies ⚠️ 0 dependency not pinned by hash detected -- score normalized to 0 Security-Policy ⚠️ 0 security policy file not detected Fuzzing ⚠️ 0 project is not fuzzed License 🟢 10 license file detected Vulnerabilities 🟢 10 0 existing vulnerabilities detected Signed-Releases ⚠️ -1 no releases found Branch-Protection ⚠️ 0 branch protection not enabled on development/release branches SAST ⚠️ 0 SAST tool is not run on all commits -- score normalized to 0

Scanned Files

• docs/requirements-dev.txt
• pyproject.toml

[codebeaver-ai]

I added some Unit Tests (average coverage improvement: +33.04%). Check it out here to merge it!

[codebeaver-ai]

No files changed in the PR

[VinciGit00]

I also run pre commit on the whole dir for

[codebeaver-ai]

I added some Unit Tests (average coverage improvement: +50.00%). Check it out here to merge it!

[silgon]

I'm just wondering, is there a reason not to use keyword arguments?
I believe you could have more understandable code, or at least not as many if elses as in the following picture.

The example would be:

def search_on_web(
    query: str,
    search_engine: str = "Google",
    max_results: int = 10,
    port: int = 8080,
    timeout: int = 10,
    proxy: str | dict = None,
    serper_api_key: str = None,
    **kwargs
) -> List[str]:
...
 google_search(
                        query,
                        num_results=max_results,
                        proxy=formatted_proxy,
                        **kwargs
                    )

You probably have a reason, you can just ignore this comment in any case. Thx again for the great package =)

[VinciGit00]

This is the definition fo the search function from google_search library.

As you can see is not present the default region

[codebeaver-ai]

I added some Unit Tests (average coverage improvement: +50.00%). Check it out here to merge it!

[silgon]

I see what you mean @VinciGit00 , however if your parameters are in the dictionary of parameters, there are going to be filled with the ** operator. Example:

def display_info(name, age):
    print(f"Name: {name}, Age: {age}")

person_info = {
    'name': 'Alice',
    'age': 30
}

display_info(**person_info)

[VinciGit00]

@silgon take a look now

[codebeaver-ai]

I added some Unit Tests (average coverage improvement: +50.00%). Check it out here to merge it!

[silgon]

Nice! 😎

[codebeaver-ai]

Job has been stopped

[codebeaver-ai]

No tests were needed for this PR, I think. If you were expecting tests, check out the documentation here to fix the issue

[codebeaver-ai]

No tests were needed for this PR, I think. If you were expecting tests, check out the documentation here to fix the issue

[VinciGit00]

@PeriniM I removed google search paragraph because it was not working anymore, probably due to new google policies

[codebeaver-ai]

No tests were needed for this PR, I think. If you were expecting tests, check out the documentation here to fix the issue

[github-actions]

🎉 This PR is included in version 1.36.1-beta.1 🎉

The release is available on:

• v1.36.1-beta.1
• GitHub release

Your semantic-release bot 📦🚀

[codebeaver-ai]

No tests were needed for this PR, I think. If you were expecting tests, check out the documentation here to fix the issue

[github-actions]

🎉 This PR is included in version 1.37.0 🎉

The release is available on:

• v1.37.0
• GitHub release

Your semantic-release bot 📦🚀