Finding Korean public domain works

On Wednesday Apr. 23rd, 2014 I attended the second class of the year for the KLTI (Korean Literature Translation Institute) Translation Atelier. This will be my fifth year as a KLTI-affiliated translator but I'm especially excited about this year's class because it's being led by Sora Kim-Russell, who has translated Shin Kyung-sook's I'll Be Right There (어디선가 나를 찾는 전화벨이 울리고) and Gong Ji-young's Our Happy Time (우리들의 행복한 시간) among other works.

During class, the topic of crowd-sourced and team translation came up and we discussed the idea of finding a non-copyrighted work to translate together as a class. Thanks to the Internet, there are a variety of sources for non-copyrighted works in Korean. Most of these works have been written by Korean authors who passed away long ago.

The first source is Wikibooks Korea. There are over 14,000 Korean public-domain documents available, including works written in Classical Chinese from the Joseon Dynasty era.

The second source is the Korea Copyright Commission, which maintains a list of works by Korean artists and writers from the late-19th century onward that are out of copyright (I noticed that most of these works are written in pure Hangul rather than in Classical Chinese).

The class hasn't yet started to discuss the logistics of team translation, but I think using some kind of CAT software would be a good idea. I use OmegaT in my day-to-day translation work, but have yet to use the team translation feature that supports git and SVN repos for storing translation memories and glossaries. I think Google Translator Toolkit (GTT) might also be a possibility (although lately I've heard it's been really slow and unresponsive) but its concordance searching and TM matching ability is far poorer than that of stand-alone locally-installed CAT applications. Regardless of what tool we end up using, any sort of team translation needs to have a mechanism for ensuring that translators don't step on each other's toes -- i.e. using multiple spellings for the same object or character and other inconsistencies in language use.

Using CINT (ROOT) as a REPL for C

  The first language I formally learned was Python and the REPL was invaluable for running quick snippets of code to get a handle on syntax and the behavior of built-in functions. I'm now taking the 2014 offering of CS50x from edX/HarvardX and one of the languages that is introduced is C.

Aside from the syntactical differences with Python, I've found it difficult to get used to the lack of a C REPL. Even running a simple 'hello world' snippet of code requires me to compile (in the course we use the clang compiler) the source file and run the output binary.

However, I recently learned that CERN has a numerical analysis package called ROOT which they use in physics research. The neat thing about this package is that it contains a built-in C/C++ interpreter that works like a REPL. From within ROOT, I can evaluate expressions like 2+2 or printf() statements without compiling:

[archjun@arch ~]$ root

  *******************************************

  *                                         *

  *        W E L C O M E  to  R O O T       *

  *                                         *

  *   Version   5.34/15  11 February 2014   *

  *                                         *

  *  You are welcome to visit our Web site  *

  *          http://root.cern.ch            *

  *                                         *

  *******************************************

ROOT 5.34/15 (v5-34-15@v5-34-15, Feb 11 2014, 18:58:45 on linuxx8664gcc)

CINT/ROOT C/C++ Interpreter version 5.18.00, July 2, 2010

Type ? for help. Commands must be C++ statements.

Enclose multiple statements between { }.

root [0] 2 + 2

(const int)4

root [1] printf("Hello\n");

Hello

root [2] 

The ROOT REPL kind of reminds me of ipython's interface. One downside of ROOT is the large size of the package -- well over 100MB -- that includes lots of analysis libraries that a beginner in C has no use for.

WinXP VM provided by Microsoft (ModernIE) is very useful for the Korean ActiveX web environment

I'm a happy user of Virtualbox on Linux. I mostly use Virtualbox to run WinXP guests on my Linux host so I can use Korean Internet banking services and shop online in Korea. You might ask, "Why do you need an ancient Windows OS just to do Internet banking?"

Some background on this situation: in the late 1990's, prescient Korean bureaucrats decided to implement PKI (Public Key Infrastructure) for all online transactions. Since existing open standards for PKI were still in the early stages back then, the Korean gov't rolled their own solution which was implemented through ActiveX plugins for Microsoft's Internet Explorer web browser.

Fast forward 15 years -- the web has evolved but the Korean PKI standard is still unchanged and all Koreans are forced to keep using old ActiveX plugins which have been left in the dustbin of history. Shopping and banking online in Korea is a hugely frustrating experience, as you must download and install new ActiveX plugins almost every time you start a new session. Although nominal Internet speeds are quite fast (several times the speed of American Internet) in practice most Korean users cannot benefit due to all the cruft they are forced to install to use native Korean Internet services (which are still optimized for the IE8 web browser).

Although IE has > 80% market share in Korea, online banking and shopping sites only support IE's older incarnations. Good luck getting modern versions of IE (11+) working on, say, the websites of Woori Bank or Auction Korea.

On modern Windows OS's, however, more recent versions of IE are installed by default. If you're one of the millions of Koreans still using WinXP, that's not a problem because IE8 is the most recent version of IE compatible with that venerable OS. For those not using XP, however, using the Korean Internet is often problematic. For example, my girlfriend's computer runs Windows 7 with a modern version of IE but she sometimes can't use certain Korean sites requiring ActiveX.

The solution? Use virtualization -- Virtualbox, VMWare, Parallels, etc. As I mentioned earlier, I use Oracle's Virtualbox. In the past I installed WinXP onto a fresh VM using an old .iso from MSDN. Even the most slimmed-down install with extraneous features omitted came in at just under 10 GB with no custom applications installed.

Whether using dynamically-allocated partitions or not in Virtualbox, after installing a few key applications for Korean banking, shopping and word processing (in the form of Hancom's infamous 한글 200x series) partitions soon balloon to 15GB or more.

Enter WinXP VM's provided directly by Microsoft through their ModernIE site -- for Virtualbox on Linux, we import a compressed OVA file that blows up to a regular VMDK image file. The bare-bones WinXP VM only takes up 1.9 GB on initial boot! Compare that to ~ 10 GB for a clean install from .iso or CD.

For users in East Asia, however, the VM cannot be used as-is because the default VM image is of a US version of Windows. Prepping the VM requires the following steps (which requires a WinXP install CD or .iso from MSDN):

1) Extract the necessary install files from the WinXP install CD or .iso - extract the entire /i386 directory from the .iso to some directory, then use the Virtualbox "shared folder" feature to make this directory readable by the WinXP guest.

2) Enable East Asian Font Support -- go into Control Panel and select "Regional Settings & Languages" and make sure the box for "East Asian Language support" is checked. The installer will then ask for the WinXP CD or a location where the installation files reside. If we point the installer to the shared folder /i386/... the language file installation will go forward. The path changes a few times during the install, so you may need to enter the /lang subfolder and then later point to the parent folder again.

3) Install East Asian Language IME (Korean, in my case) - go into Control Panel and select "Regional Settings & Languages" once more but this time click on "input methods" instead of "languages"-- now choose Korean and make it the default. After a reboot, pressing the Hangul key (Right Alt on non-Korean keyboards) will toggle Korean language input.

There are also some Virtualbox-specific VM settings that you might want to change. The default memory setting is 512MB, but I changed this to 1024MB. Also I had problems booting the VM before enabling the Virtualbox "System" option, I/O APIC. For those users who store their Korean banking PKI certs on a USB thumb drive, you will need to enable USB 2.0 in the VM settings and also separately download the Oracle VM VirtualBox Extension Pack and load it from the Virtualbox Manager (under File -> Preferences -> Extensions).

Rearming the WinXP VM after 30 days

Note that the WinXP VM's from ModernIE will only run for 30 days. After that, a dialog box will appear at boot asking you whether you want to activate your copy of Windows. If you click 'No', the system will automatically reboot. Microsoft initially said that taking a snapshot image upon first importing the VM and later restoring that image would reset the activation clock, but this is actually not the case!

When 30 days have expired, what I do is restore a clean snapshot (which will still ask for activation) and then boot into Safe Mode (pressing F8 to bring up the Windows boot menu and selecting 'Safe Mode'). After booting open a Command Prompt and type the following:

rundll32.exe syssetup,SetupOobeBnk

Even with a successful activation, there will be no output.

Now reboot into a regular session and the activation clock will be reset to give you 30 more days!

Although Microsoft says that the WinXP VM activation counter can be reset up to 3 times (for a total of 90 days), by restoring a snapshot from a clean install and booting into WinXP Safe Mode and resetting the activation from the command prompt/CLI I've been able to use the same VM for more than 90 days!

Enabling ibus support in OmegaT

In my translation work, I use OmegaT as my CAT tool. Up until 2009, I used Trados on a Windows system, but I finally got fed up with the bugginess and resource-hogging of Trados and switched to OmegaT 2.xx series later that year.

Although OmegaT is rock-solid, it does require some manual setup from the user, especially on Linux. As a translation environment, OmegaT must play nice with various IME's (input method editors) for inputting multiple languages on Linux. Today ibus seems to be the most popular IME on Linux, although many users needing to input East Asian languages still use scim.

Here's my setup for making OmegaT work with ibus-hangul, as I work with both Korean and English on Linux.

1. Add the following entries to your ~/.bashrc file:

export GTK_IM_MODULE=ibus
export XMODIFIERS=@im=ibus
export QT_IM_MODULE=ibus
export CLUTTER_IM_MODULE=ibus

2. Make sure that the ibus daemon loads at system startup (the specifics depend on what Desktop Environment you are using) with the following flags (in the case of Openbox, I have added the following entry to ~/.config/openbox/autostart):

env IBUS_ENABLE_SYNC_MODE=0 ibus-daemon -rdx

Where:
the -x --xim flag launches the ibus XIM server
the -d flag tells ibus to daemonize or run as a background process
the -r flag tells ibus to replace any old ibus daemons which are currently running
the prefix IBUS_ENABLE_SYNC_MODE=0 is necessary if you want ibus to work with non-GTK / non-QT apps such as Java or EFL (Enlightenment). If this option is not set, the SPACE character will not be correctly inserted for Hangul and other Asian languages. (ex: '가나다 ' will print as '가나 다' with space inserted to the left of the final character)

You can also reload ibus manually by typing the above from the command prompt.

3. In your OmegaT startup script, make sure to invoke OmegaT.jar with the following prefix:

XMODIFIERS=@im=ibus ... /path/to/OmegaT.jar

Here's a sample startup script that launches OmegaT with built-in support for Google Translate API v2 and Microsoft Translate API (the API keys are dummies in this example, of course) where OmegaT.jar has been installed to the folder ~/OmegaT_3.0.8:

#!/bin/bash
XMODIFIERS=@im=ibus java -jar -Xmx512M -Dgoogle.api.key=123456789-aBCde_fgHIjk-l-mnopqrs_tuvw_1 -Dmicrosoft.api.client_id=omegat_KE -Dmicrosoft.api.client_secret=1234567890AbCDEFghijkLMnopqrstuVWXYZ1122334= ~/OmegaT_3.0.8/OmegaT.jar

Taking fullscreen screenshots every second using Imagemagick import

While I normally use scrot attached to hotkeys using obkey for taking screenshots, for more complex screenshot tasks Imagemagick's import is an indispensable tool. For some reason, the man page for import on my Arch Linux system doesn't show the complete listing of all available options. A full listing requires one to refer to several different resources (here and here).

Say, for example, that we want to take 10 full-screen screenshots every second starting in 10 seconds and save the files in the ~/Images subfolder with the name snap.png. With imagemagick import we can do this with the following command:

import -window root -delay 10 -snaps 10 -pause 1 ~/Images/snap.png

-window root tells import to take a screenshot of the entire screen

-delay 10 tells import to wait 10 seconds before starting to take screenshots

-snaps 10 tells import to take 10 screenshots

-pause 1 tells import to wait 1 second between snaps

import will automatically number the screenshots snap-0.png ~ snap-9.png

Canon Pixma MG2400 Series (2490) support in Linux

I recently purchased a cheap inkjet/scanner Canon Pixma MG2490 for less than $50. I have had good results with the Canon Pixma MP 258 (MP250 series) which is fully supported in SANE.

After connecting the MG2490 to my machine I ran lsusb and got the following output:

[archjun@arch ~]$ lsusb
Bus 007 Device 006: ID 04a9:176c Canon, Inc.
...

Unfortunately, the MG2490 is not yet supported by SANE. Although sane-find-scanner returns

found USB scanner (vendor=0x04a9 [Canon], product=0x176c [MG2400 series]) at libusb:007:006

scanimage -L doesn't find any compatible scanners (not correct; see update below)

The proprietary Vuescan recognizes the MG2490 and provides basic scanner access in the free version (although a full-featured version costs $39.95 ~ $79.95). The free version embeds a full-page patterned watermark (Buy Vuescan Now!) throughout the scanned image, so this is a no-go for anyone who needs clean scans and wants to use FOSS.

UPDATE 2014-06-18: Actually SANE does recognize the MG2490. scanimage -L returns:

device `pixma:04A9176C_60C204' is a CANON Canon PIXMA MG2400 Series multi-function peripheral

Xsane also recognizes the MG2490, although it takes several minutes as it scans for devices. Once the scan interface appears, however, pressing "Scan" or "Acquire Preview" does nothing and just hangs.

Note that Canon provides .deb and .rpm packages for the MG2400 series. The scanner driver rpm can be found at:

http://support-au.canon.com.au/contents/AU/EN/0100551601.html

The above package depends on the cnijfilter-mg2400 package whose rpm can be found at:

http://support-au.canon.com.au/contents/AU/EN/0100549901.html

Printing works just fine OOTB without installing the Canon print driver -- if you install the gutenprint package, there is a ppd file that CUPS can use to detect the MG2940.

The problem right now is getting scanning to work, however...

UPDATE 2014-09-16 Pixma MG2400 series is now supported

According to this thread from sane-devel, Rolf Bensch has patched the latest sane backend in the sane git repo. I haven't yet had time to test the patched version of sane on the MG2490. When I get the chance, I will present my findings here.

libreoffice와 ibus 호환 문제 해결 방법 (Arch Linux, Debian)

ibus과 ibus-hangul을 설치했는데도 libreoffice에서 한글 입력이 안 되면:

libreoffice-gtk 설치 해보세요 (Ubuntu나 Debian 파생 distro 쓰고 있는 경우)

libreoffice-gnome 설치 해보세요 (Archlinux 쓰고 있는 경우)