auth fix #402
Comments
|
after change it into growik, the script pass the low scan, let me choose the option, scraping the database (very slow) and then stop, nothing downloaded. |
You should provide logs and config file |
|
Same issue as user above, log and config below issue may stem from `" 2024-06-06 13:37:11:[helpers.inner:11] Traceback (most recent call last): 2024-06-06 13:37:11:[scrape_context.scrape_context_manager:37] ` |
I was about to record another fresh log for you but now it's starting to scrap (weird), using growik, same config, latest commit 3.10.2, exactly 24 hour after it crash the first time. |
|
Yes I tried the new stuff. python3 -m pip install git+https://github.com/datawhores/OF-Scraper.git@3.10b or python3 -m pip install git+https://github.com/datawhores/OF-Scraper.git conf: |
This is a different issue and should be fixed in 3.10.2 |
|
This is the only one that would work and did you update the auth file |
yes, i'll try again Edit: Works with auth from Brave, didn't work with from Edge or Firefox. |
|
I still cannot figure this out. Script version is 3.10.2, confirmed with ofscraper --version command. Config is as follows: }, Yet it keeps asking me to fill out my auth info every time. |
|
Are you getting logged out when you try |
Nope. I've double checked that the auth is filled out correctly, too. |
|
I'm getting what looks like (to me) the same error: LogThis log file is from checking out the Every time I try running it, I get logged out of OF. ConfigSpoiler text. Note that it's important to have a space after the summary tag. You should be able to write any markdown you want inside the {
"main_profile": "main_profile",
"metadata": "{save_location}/{model_username}/Metadata",
"discord": "",
"file_options": {
"save_location": "/data",
"dir_format": "{model_username}/{responsetype}/{value}/{mediatype}/",
"file_format": "{filename}.{ext}",
"textlength": 0,
"space_replacer": " ",
"date": "MM-DD-YYYY",
"text_type_default": "letter",
"truncation_default": true
},
"download_options": {
"file_size_max": 0,
"file_size_min": 0,
"filter": [
"Images",
"Audios",
"Videos"
],
"auto_resume": true,
"system_free_min": 0,
"max_post_count": 0
},
"binary_options": {
"mp4decrypt": "/home/ofscraper/bin/mp4decrypt",
"ffmpeg": "/home/ofscraper/bin/ffmpeg"
},
"cdm_options": {
"private-key": null,
"client-id": null,
"key-mode-default": "cdrm",
"keydb_api": ""
},
"performance_options": {
"download-sem": 6,
"threads": 2
},
"advanced_options": {
"code-execution": false,
"dynamic-mode-default": "deviint",
"backend": "aio",
"downloadbars": false,
"cache-mode": "sqlite",
"appendlog": true,
"custom_values": null,
"sanitize_text": false,
"temp_dir": null,
"remove_hash_match": false,
"infinite_loop_action_mode": false,
"post_download_script": null,
"disable_auto_after": false,
"default_user_list": "main",
"default_black_list": ""
},
"responsetype": {
"timeline": "Posts",
"message": "Messages",
"archived": "Archived",
"paid": "Paid",
"stories": "Stories",
"highlights": "Highlights",
"profile": "Profile",
"pinned": "Posts"
},
"overwrites": {
"audios": {},
"videos": {},
"images": {},
"text": {}
}
}This is running with docker-compose, using command:
|
Yes. Apparently after three attempts, which look like: |
|
Similar issues here! Have 10.0.2 installed, config updated to growik, using Firefox and the OF Cookie Helper to grab auth info, added it to the Auth file, can't get past the auth screen in ofscraper. I also get logged out of the OF website sometimes after running ofscraper. |
|
ofscraper_main_profile_2024-06-07.txt Also cannot get past the Authentication. I started today with 3.9.x2ish? and ended up with authentication error. Tried paste cookie details again, still auth error. so now on 3.10.2 |
|
Please update to and when the 400 error happens make sure to double check the information printed to console to make sure that it matches with what your browser says Make sure that you check to make sure that the user_agent is correct, and that there are not any additional spaces |
Thanks, updating to 3.10.3 AND changing dynamic rule default to : growik made the trick... |
|
It just some data that is added to identifiy a requests as valid They all do the same thing, the only difference is that the other options are not up to date with changes on the site |
It said 3.10.4 when I upgraded just now
Which one is "the right" one? I read above that another user changed the default to "growik" so I did the same and it seems to work now. |
|
growik is the only option that works at the moment
|
I've noticed that growik working speed is pretty much slow compare to deviint, is that the nature of it or it just myself? |
I mean they all are being served via github so they should all be quick |
|
I can confirm I just did a fresh install and I got v3.10.4 which is correctly downloading content again, using "growik". Many thanks @datawhores |
Did you just change the word to growik in the configuration or do you have to do something else because it doesn't work for me |
|
Seems to be working for me as well with 3.10.4 and growik, thanks! |
What browser are you using or how did you make it work? I can't get it to work. |
|
So what steps need to be take to "change dynamic-mode-default to growik"...? I've been looking but I cannot find it |
|
Hi. I updated to commit 51c48a2. The script starts, reaches auth info input stage. I enter the data manually, but then the script does not want to work further and throws me back to the auth info input stage. |
I placed it in the "advanced_options" block. As this is JSON, which has to be parsed into some native hash table then I presume it doesn't matter where exactly inside that block you put it. For example: #WORKSFORME |
|
[bogdanbdg], thank you. Works for me too. |
works for me now too, thank you. |
|
with the latest 3.10b commit 87ee763 and the config: the error is: EDIT:but all works correctly with this commit if I use this: thanks for support |
|
With the version 3.10.6 There is my config : "advanced_options": { there is the error starting script[close.sendCloseMessage:41] Finished Script close.py:41 Queue <multiprocessing.queues.Queue object at 0x00000206BAB68B10> is closed Queue <multiprocessing.queues.Queue object at 0x00000206BAB68B10> is closed |
growik don't works anymore, you need change it in deviint |
Its worked. I changed changed in deviint as you told and its worked. Thanks you. |
|
looks like deviint got pulled cause it is showing 404 now |
|
3.10.6 on deviint with or without the custom value just after 2nd or 3rd entering of auth details from cookie helper progresses to blue "Activity progress" as it actually managed to log in but at that same point it dies. |
|
The current rules might be outdated try DIGITALCRIMINALS = ( |
|
Can someone give me an idea of what I'm supposed to be updating this time? All of those URLs need to be formatted into the section below?
|
Only the Datawhores and rafa-9 work, the other 2 are missing some values, like the prefix |
replace the URL in the custom_values -> DEVIINT with the contents of the RAFA_URL string |
Like this: ? Because if "yes" then this doesn't work and logs me out of OF, printing my auth.json to console on the way |
|
So, wait, what's the latest here? Is the issue still outstanding, and/or what's the fix? Thanks!! |
|
For posterity, running v3.10.11 and using rafa_url works for me now. |
Could you post the |
It's the one from above. |
Edit: It finally worked after turning back 2FA on and editing the auth values on the terminal instead of updating the auth.json file externally. Config: |
|
How do you edit the auth values on terminal like what did you type specifically because I can't update/overwrite the -dr/--dynamic-rules it's only either dc/deviint and neither are working for me and auth info still reverts back to deviint when updating the file in .config folder This error shows up when I try to change the -dr/--dynamic-rules via terminal |
|
you have to update then the latest version is |
|
there is a bug in the recent versions config.json code, i had to go back to 3.10.17 to get it working i was on a very old version and it recently stopped working so i found this thread. i backed up my .config to a different location, cleared out .config, and tried a fresh install of 3.10.20 but it kept making a config.json file with old properties that no longer exist. also using the CLI to edit the config.json options didn't save any of them. it had "thread_count" instead of "threads" and a few other things. if you manually edited the config.json in a text editor it would revert your changes upon starting the program. i went back a few versions to 3.10.17 and it created the newer config.json and the cli actually applies the changes |
|
Where are the "--dynamic-rules [argument]" |
|
Yes the config was changed slightly recently |
|
You should not have to change dynamic rules frequently. I'm not sure the exact amount but they usually last for a week or more |
The recommended method of keeping proper auth is to keep up to date with the latest version of the script |
and others
The recommended method to ensure proper auth is to just upgrade to the latest version
If your using a very old version of the script then the amount of support will be limited
Generic Instructions
Instead of using 'growik' use one of the valid urls listed below
If your on 3.10.7 or using the latest commits use this pattern instead of option 1
List of valid urls
https://gist.github.com/datawhores/76914ae80944fe1913789e232a9b52f0
The text was updated successfully, but these errors were encountered: