this post was submitted on 28 Aug 2023
131 points (82.6% liked)
Asklemmy
43340 readers
2067 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- [email protected]: a community for finding communities
~Icon~ ~by~ ~@Double_[email protected]~
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Seriously asking: How does one get a complete siterip of a site that publishes new content all the time?
I regularly check the sites about 1 time a month. I also have a little bot the looks for WRB (scene ripper) releases as he is the one that rips those sites. I don't technically need to check the site but I just like to make sure 100% it's fully up to date. The tiny4k site is half me and the rest scene since there was a way to web-dl the videos for about a week before they fixed it.
I then post monthly packs on kleverig (usenet) to help the guys that don't want to do it themselves.
Probably its just a snapshot at some point, with maybe downloading new stuff when its published. At least thisbis how i'd do it.