Comments on: Postcards from a Text Processing Excursion http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/ Trying to find useful things to do with emerging technologies in open education Sat, 25 May 2013 00:12:21 +0000 hourly 1 http://wordpress.com/ By: Craig Russell (@craig552uk) http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/#comment-24362 Thu, 02 Aug 2012 19:27:37 +0000 http://blog.ouseful.info/?p=5579#comment-24362 Did you ever get the hang of join?

I blogged about it not too long ago:

http://craig-russell.co.uk/2012/07/13/join-data-files-command.html#.UBrT6jSPW0w

Ping me if you need a hand.

]]> By: Tony Hirst http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/#comment-23023 Fri, 22 Jun 2012 00:10:40 +0000 http://blog.ouseful.info/?p=5579#comment-23023 @patrick Have you tried using the csvkit tools? http://csvkit.readthedocs.org/en/latest/index.html

Alternatively, how about trying to recode the file in a text editor, or running the file through Google Refine (eg value.reinterpret(“utf-8″) as described in http://code.google.com/p/google-refine/wiki/Recipes )?

]]> By: Patrick http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/#comment-22994 Thu, 21 Jun 2012 10:40:28 +0000 http://blog.ouseful.info/?p=5579#comment-22994 Just discovered this and am anxious to try it out. Unfortunately I ran into a problem with the cut command:
cut: sample.csv: Illegal byte sequence
Apparently this could have something to do with the encoding of the file. I tried iconv to change the encoding like this:
/usr/bin/iconv -f ISO-8859-1 -t UTF-8 sample.csv
but still get the same error when trying to cut.
Is there any way I can find out what the original encoding of my file is?

]]> By: Exploring GP Practice Level Prescribing Data « OUseful.Info, the blog… http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/#comment-21864 Fri, 27 Apr 2012 21:10:45 +0000 http://blog.ouseful.info/?p=5579#comment-21864 [...] if you’ve read my previous posts on Playing With Large (ish) CSV Files or Postcards from a Text Processing Excursion, or maybe even the aforementioned local sentencing data post, you may have some ideas about how to [...]

]]> By: Accessing and Visualising Sentencing Data for Local Courts « OUseful.Info, the blog… http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/#comment-17569 Tue, 29 Nov 2011 13:20:36 +0000 http://blog.ouseful.info/?p=5579#comment-17569 [...] Large (ish) CSV Files, and Using Them as a Database from the Command Line: EDINA OpenURL Logs and Postcards from a Text Processing Excursion I give a couple of examples of how to get started with some of the Unix utilities, which we can [...]

]]> By: Quick Command Line Reports from CSV Data Parsed Out of XML Data Files « OUseful.Info, the blog… http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/#comment-11071 Mon, 25 Jul 2011 11:11:50 +0000 http://blog.ouseful.info/?p=5579#comment-11071 [...] for each dataset along the lines of the text processing tricks I posted around the EDINA data in Postcards from a Text Processing Excursion, Playing With Large (ish) CSV Files, and Using Them as a Database from the Command Line: EDINA [...]

]]> By: Playing With Large (ish) CSV Files, and Using Them as a Database: EDINA OpenURL Logs « OUseful.Info, the blog… http://blog.ouseful.info/2011/06/03/postcards-from-a-text-processing-excursion/#comment-10508 Sat, 04 Jun 2011 22:24:06 +0000 http://blog.ouseful.info/?p=5579#comment-10508 [...] up on Postcards from a Text Processing Excursion where I started dabbling with Unix command line text processing tools (it sounds scarier than it [...]

]]>