Suddenly, Muju Little Ponythulhu: Ftaghn is Magic:
Congratulations! If you're seeing this, you're at the brand new site. I'll add more notes here as I continue to migrate, but for now, you're at the right place. Note: IRC is at irc.thisisnotatrueending.com; if you were using xen.thisisnotatrueending.com, it'll time out, so check your settings.
The IRC and website migration went off without a hitch, which is a pleasant surprise given my usual track record with this sort of thing. As far as I'm presently aware, the entire archive should be moved and available, so you can start browsing, voting and adding new threads. If you run into any weird issues, please post them here, along with the URL and full error message. (Yes, the game, player and hamachi listings are all down right now, but I need to clean out the spam that got into them first...)
Reminder: July 1 is when the old server goes down permanently, including the graveyard. LIST OF GRAVEYARDED THREADS If there's a good thread you want saved, make a case for it in the comments here, otherwise just save a copy (I suggest DownThemAll!) or transcribe the content onto 1d4chan.
Once I'm satisfied that everything is working correctly, I'll be hosting torrents and direct downloads of the entire archive, from October 2007 through June 2011. I already have the files, I just need to make them available without taxing the server too heavily. Fortunately, I've got more hard drive space and bandwidth than I know what to do with now; I don't know what the pageload speed will be like under the new provider, but you're welcome to let me know if it's faster/slower, I'm curious.
And now, as it's 6am, I'm going to sleep. There's a couple other services to migrate (TeamSpeak, icecast, etc.), but it can certainly wait. Let me know if anything breaks.
Edit June 22: I just found a config error that prevented threads archived in the past 24 hours from being correctly updated; you may see some threads with incomplete content. If you happen to have the full HTML for these threads (likely quest authors) let me know and I'll update the thread with your copy.
Edit June 29: Per popular request, I've resurrected LoliQuest from the graveyard (and even grabbed the very first entry off Easymodo, which apparently put the /tg/ archives back up). I'm adding them back to the database and uploading the files as I type this. For anyone that wants the graveyard 7zip, PM me on the IRC and I will give you the download link for the file. The graveyard and old server are going away on July 1 or shortly thereafter, so you've got two days to get it if you want it!
I've started graveyarding. See LIST OF GRAVEYARDED THREADS. Completed: June 2010, July 2010, August 2010, September 2010, October 2010, November 2010, December 2010, January 2011, February 2011, March 2011, April 2011
I've also found a VPS provider and set up a box, so it should actually be a pretty simple process now to just move shit over. I'm going to finish the graveyarding within the week, move files, and have everything done by June 20. The old server will remain online until the last minute on July 1. After that, at the new host, I'll begin offering downloads for the entire archive piecemeal (e.g. August-September 2010 in a single file, torrents probable).
As before, if you see a thread you think should be preserved, name the thread number and make a case for it. Nine times out of ten, instead of it being preserved in the archive, you should rip the content out and throw it on 1d4chan. And there's always... uh, hm. It looks like Easymodo took down its /tg/ archiving service. Whoops! I guess it really is all up to me now.
Current Stats: 842 threads removed (6.3 GB), plus 57 drawthreads removed (3.8GB)
The server move finally has a hard deadline: July 1, 2011. I have to move sup/tg/ to a new provider by then or everything simply disappears into the ether. So that means it's time for a culling!
Like the last time, the archive is going to be purged of unwanted threads by
whatever poor assholes I can rope into helping me a team of qualified, highly-trained content experts. What are the criteria, you ask? Wait, you didn't ask? WELL FUCK YOU I'M TELLING YOU ANYWAY:
Like before, the deleted threads will be moved to a graveyard where anyone who really wants that aforementioned horrible thread can still download it. (Image threads will not be given this treatment this time around. You knew better when you added it.) I will update this post or a future post with the growing list of graveyarded threads and links to download them.
When the culling is done, I will begin uploading threads by month to Dropbox, Megaupload, or whatever other service I can find as a failsafe. If I get hit by a bus, I don't want the archive to just disappear and lose the last four years' worth of amazing /tg/. I'll likely be moving to Varsbox unless someone else can suggest a good VPS provider that will fit the following criteria:
I'm going to get started on getting people to cull the archives. For those of you who give no shits either way, I've updated the archive page so that you can hide quest and draw threads now, so there's that.
Edit: For those of you helping me, I'd like you to go through a full month at a time (helped now by the handy dandy new archive page), and give me a list like the following:
Thread Number - Title - Score - Reason
You don't have to get fancy with the reason, just "quest thread" or something so I know why it should be removed. Remember, these are just recommendations; I may end up keeping a thread after all, though most of the time I'm sure the thread deserves to be eliminated. Please also include a separate list of just the thread numbers so I can plug them more easily into my tools. Extra lists of questionable items or threads to make into collections are also good.
Edit 2: Of the 6805 threads currently archived, 465 threads contain the tag 'draw' (drawfag, drawthread) and 2090 contain the tag 'quest'. That's right, a full 30% of the archive is composed of quest threads. ಠ_ಠ
Edit 3: 392 draw threads at a total of 3.8GB removed on the first pass. (Culled List) Also I guess I should clarify: I'm going to leave the "deleted" threads online until Friday or something, then they're permanently being deleted. The graveyard I'm going to leave for as long as I still have this server. I could leave Deleted and Graveyard together I guess but this gives me a directory to dump so I can get more disk space as I archive and transfer batches of threads.
Edit 4: Jesus Christ there were fucking 335 threads in May alone, 137 of which have "quest" in the tags. I need to look about changing the way threads get archived, or be extremely aggressive in future culls. Maybe something like deleting threads below 5 or 10 or something, or (ugh) requiring multiple votes to add a thread ala 4chanarchive.
Ultimate question: Should I ban quest threads, or just aggressively cull them?
Edit 5: Anon raised a good point that made me wonder: how long does Easymodo store threads? Do they have a purging policy or any of that? How far back does it go? Hell, it'd make my life massively easier if I just hosted a listing service for /tg/ that linked to archived threads on Easymodo. Would Eksopl mind? What does he use for a hosting provider, anyway? QUESTIONS, MAN.
If anyone could put me in touch with Eksopl so I can ask some questions about how he runs things over there, I'd be much obliged. Either I could just set the archive to link to Easymodo, or buy hosting from the same company.
Happy April Fool's Day everyone! I hope you're enjoying the shit all over the internet today! It's also fucking 7:30 in the morning christ I need sleep oh god why am I awake.
Only three pages today, I'll likely add one or two more later, but sleep now, oh god why. Old pages:
BEAR CHEF SAYS
We're done culling the archives! Yaaay!
You presently have
48 hours* until Friday, August 6* to get everything you want from the following list:
*or however long it takes me to turn off the server.
Anyway, the links on that page have all been updated to the old website, so you can download whatever you'd like to keep. Do not scrape the website or you will be banned. Art dumps and drawfag threads will be uploaded later to MegaUpload or something so don't bother with those, you'll get them in a tidy .rar at some point, or they're already on tgchan (I'll get the links for those and add them here). If anyone would like to officially or unofficially start transcribing writefag threads to 1d4chan please go ahead.
Remember, this is a general 48-hour window, but I'm not going to delete the threads for a long while (if ever), so if you miss it don't fret. Just ask and I'll be happy to send you a copy of whatever you'd like. Again, don't scrape the site because you feel like everything deserves to be saved; it really, really fucking doesn't, and if you haven't seen the culled list yet, you'll quickly figure out why.
After the window I'll start moving ~5GB of the surviving threads to the Xen a day until it's up to speed, cull July, and we should be all set. By next week or so we should be up to speed, unless of course I get sucked into Minecraft to the exclusion of all else... again...
Edity: Oh yeah, you'll notice the "saved" thread still show up in the culled list. I can't be fucked to bother removing them from the list, but if you asked me to save something (like those mislabeled quest threads and the like) I'll be restoring them during the move.
Edity 2: I've decided to leave the graveyard up until at least Friday, if not beyond that; the bandwidth usage from people snagging "killed" threads is way less than I thought it was going to be. Remember, the graveyard is here. I'm going to start transferring tonight.