OSDN Git Service

utf8_string, utf8となっていたものを、scheme中のUnicodeの基点となるUniCharとUniStringに正規化。
authorderui <derutakayu@user.sourceforge.jp>
Thu, 10 Sep 2009 14:41:48 +0000 (23:41 +0900)
committerderui <derutakayu@user.sourceforge.jp>
Thu, 10 Sep 2009 14:41:48 +0000 (23:41 +0900)
commitf971fd3e5c5dbc2ff98592a0836a3e4c67eab0cc
tree7bf8c68734b3f164ef77c00244c0754b8e2d4f4a
parentf402e8faea4f7af25e9473478485aad6f09ce7c0
utf8_string, utf8となっていたものを、scheme中のUnicodeの基点となるUniCharとUniStringに正規化。
utf8の読み出しは、schemeのportに似せたBinaryPortとTranscoderの組合せで読出すように変更中。
38 files changed:
.gitignore
binary_port.cpp [new file with mode: 0644]
binary_port.h [new file with mode: 0755]
delimiter.cpp [changed mode: 0644->0755]
delimiter.h [changed mode: 0644->0755]
lexeme.h
lexeme_impl.cpp
lexeme_impl.h
lexer.h
literal.cpp
literal.h
literal_data.cpp
literal_data.h
literal_impl.cpp
literal_impl.h
number_lexer.h [changed mode: 0644->0755]
port.h [new file with mode: 0755]
primitive.cpp [changed mode: 0644->0755]
primitive.h
sublexer_impl.cpp
sublexer_impl.h
test/Makefile.am
test/cons_test.cpp
test/environment_test.cpp
test/sublexer_test.cpp [changed mode: 0644->0755]
test/unicode_test.cpp [moved from test/utf8_string_test.cpp with 68% similarity, mode: 0755]
test/utf8_transcoder_test.cpp [moved from test/utf8_test.cpp with 100% similarity]
transcoder.h [new file with mode: 0755]
tree.cpp
tree.h
unicode.cpp [new file with mode: 0755]
unicode.h [new file with mode: 0755]
utf8.cpp [deleted file]
utf8.h [deleted file]
utf8_string.cpp [deleted file]
utf8_string.h [deleted file]
utf8_transcoder.cpp [new file with mode: 0755]
utf8_transcoder.h [new file with mode: 0755]