4 min

In Progress - Migrating content to live site

Use simple REST API to migrate my real content from this Jot Hut test site and from Toledo Talk into the live Jot Hut site.

From test jot jut

select * from content where type in ('b','m') and status='o' order by id asc

Preserve all the data except anything that was a reply blog post, so ignore the parentid from the test content.

Preserve created date.

may need to add an import date column to content table

July 29, 2013 update

  • created rest client script to read content from kestrel and to send it to junco server app.
  • created a server module to receive client data and to input it into the database, preserving created and modified dates.
  • junco content db table does have the importdate column, and that info is displayed on blog and microblog posts.

In July/August, 2013, all the blog and microblog content in the Kestrel app was migrated/imported to Junco and the live JotHut site.

Sep 17, 2013 update

Need to import my microblog content from Toledo Talk to Jot Hut (Junco).

If a script is used to import blog/wiki posts from Toledo Talk to Jot Hut, then read this: Migrating tt blog and wiki posts to junco.

I'm finally resuming this. I migrated a batch of 250 microblog posts back in mid-August, and I only migrated the second batch today. So as of Sep 17, 2013, 500 of my microblog posts at Toledo Talk have been migrated to Jot Hut.

A total of nearly 17,160 microblog posts need to be migrated!! Whoa.

I created the microblog feature at Toledo Talk in September 2007. I used it some, but when Yahoo! shutdown the Delicious bookmarking service, then I used the TT microblog feature as a link blog tool.

I planned to migrate 250 microblog posts per day, so as to no raise suspicion with my Web hosting company even though both sites are hosted at the same company, and both sites are owned by me. I suppose that I could contact support and ask if I can do larger bulk migrations.

17,000 mb posts migrated in batches of 250 per day will take 68 days to complete or just over two months. I would have five weeks down, if I had kept up with this when I started.

Maybe I'll migrate 1000 per day but in four batches spread throughout the day. Morning. Afternoon. Evening. Late night.

Old Writings

Migrated old posts from various Blogger accounts that I maintained briefly early to mid last decade (2002-2005).

Still need to migrate over 100 blog posts from my area birding blog.

Need to copy old Greymatter blog posts that I hosted at hypermart. These posts are located on DvD backup disks.

Need to copy old K5 posts. - maybe not -
http://en.wikipedia.org/wiki/Kuro5hin#Death_Date
"As of October 2013, the site is no longer accessible."
A few weeks late, but I snagged everything that I think I posted at K5 from Google cache.

Need to copy some old e-mail writings.

Old TT posts

Separate from the microblog posts below, I have a lot of content to migrate or copy from ToledoTalk.com. This will take me several months, especially for the comments. I prob create a script for the type='b' posts produced by the parula (new) Toledo Talk code.

I did not store markup for comments, only formatted content. Ouch. I wish that I had stored the markup for comments because I created a lot of heavily-formatted comments. I could import the formatted (HTML) content of my comments with a script.

Right now, I plan to manually copy my comments from the old and new versions of Toledo Talk. I'll try to migrate my thread posts and article posts with scripts to preserve creation dates.

As of Oct 18, 2013:

  • jr has contributed to 1129 articles and has submitted 3901 comments at the new version of Toledo Talk.
  • At the old version of Toledo Talk, jr posted 1227 topic(s) and 4300 comment(s).

That's over 9000 posts, but I won't have a need to copy all of my comments.

Microblog posts migrated

  • 250 on Aug 13
  • 250 on Sep 17
  • 250 on Sep 25 a
  • 250 on Sep 25 b
    • 1000 total thus far
  • 500 on Sep 26
  • 500 on Sep 27 a
    • 2000 total
  • 500 on Sep 27 b
  • 500 on Sep 30
    • 3000 total
  • 500 on Oct 7
  • 500 on Oct 10 a
    • 4000 total
  • 500 on Oct 10 b
  • 500 on Oct 14
    • 5000 total
  • 500 on Oct 15
  • 500 on Oct 17 a
    • 6000 total
  • 500 on Oct 17 b
  • 500 on Oct 18
    • 7000 total
  • 500 on Oct 21
  • 500 on Oct 22
    • 8000 total
  • 500 on Oct 23
  • 500 on Oct 31
    • 9000 total
  • 500 on Nov 1 a
  • 500 on Nov 1 b
    • 10,000 total
  • 500 on Nov 3 a
  • 500 on Nov 3 b
    • 11,000 total
  • 500 on Nov 4
  • 500 on Nov 8
    • 12,000 total
  • 500 on Nov 12
  • 500 on Nov 13
    • 13,000 total
  • 500 on Nov 15 - a
  • 500 on Nov 15 - b
    • 14,000 total
  • 500 on Nov 21
    • 15,000 total
  • 500 on Nov 27
  • 500 on Dec 5 - a
    • 16,000 total
  • 500 on Dec 5
  • 438 on Dec 6 - That's all!
    • 16,938 of my microblog posts migrated from ToledoTalk.com

#junco - #juncotodo - #inprogress

From JR's : articles
887 words - 4711 chars - 4 min read
created on
updated on
import date 2013-08-12 21:50:24 - #
source - versions - backlinks

Related articles
In Progress - Add webmention client code to Junco - Oct 21, 2013
In Progress - Junco end-user testing - Oct 17, 2013
In Progress - Add Microformats support - Oct 07, 2013
Resolved - Add keyboard shortcuts to split-screen typing mode - Mar 28, 2014



A     A     A     A     A

© 2013-2017 JotHut - Online notebook

current date: Mar 28, 2024 - 6:55 a.m. EDT