Charset CkPython Reference Documentation

CkCharset

Current Version: 11.5.0
Requires Chilkat Bundle License

Deprecated — scheduled for removal

Legacy character-set conversion utilities. Migrate before Chilkat v12.0.0.

Do not use Chilkat.Charset in new development. The entire class is deprecated and is scheduled to be removed in Chilkat v12.0.0. Existing applications should migrate now. Equivalent functionality is available in the free Chilkat.BinData and Chilkat.StringBuilder classes.

Chilkat.Charset is a legacy class for converting text between character encodings, reading and writing encoded text files, inspecting or rewriting HTML charset declarations, encoding and decoding HTML entities, validating byte sequences, and performing several older text utilities. It remains documented only to support maintenance and migration of existing applications.

Use BinData for bytes

Store raw bytes, load and save files, append byte-order marks, and move encoded data between files, memory, and other Chilkat objects.

Use StringBuilder for text

Hold Unicode text and perform charset encoding or decoding, URL processing, HTML entity conversion, case conversion, and related text operations.

Prefer UTF-8

For new text formats and interchange, use UTF-8 unless a protocol or legacy system explicitly requires another encoding.

Keep bytes and characters distinct

A charset defines how text characters map to bytes. Binary encodings such as Base64 or hexadecimal solve a different problem and are not character sets.

Legacy HTML helpers

The class can inspect and rewrite HTML charset metadata, but these helpers do not validate that declared metadata matches the actual bytes.

Maintenance only

Continue using this class only while maintaining older code, and plan a tested migration before adopting Chilkat v12.

Migration pattern: load encoded bytes into BinData, decode them into a StringBuilder using the known source charset, work with Unicode text, then encode back into BinData using the required destination charset. This makes the boundary between bytes and text explicit and replaces the stateful FromCharset/ToCharset workflow.

Object Creation

obj = chilkat.CkCharset()

Properties

AltToCharset
# strVal is a string
# ckStr is a CkString
charset.get_AltToCharset(ckStr);
strVal = charset.altToCharset();
charset.put_AltToCharset(strVal);

Specifies the alternate destination character encoding used only when ErrorAction is 6.

If a decoded input character cannot be represented in ToCharset, Chilkat attempts to encode that character using this alternate charset. If the alternate conversion also fails, the character is omitted from the output.

Mixed-encoding output: The result can contain a mixture of byte encodings. Such output is usually unsuitable for interchange unless the receiving format explicitly supports this behavior.

top
DebugLogFilePath
# strVal is a string
# ckStr is a CkString
charset.get_DebugLogFilePath(ckStr);
strVal = charset.debugLogFilePath();
charset.put_DebugLogFilePath(strVal);

If set to a file path, this property logs the LastErrorText of each Chilkat method or property call to the specified file. This logging helps identify the context and history of Chilkat calls leading up to any crash or hang, aiding in debugging.

Enabling the VerboseLogging property provides more detailed information. This property is mainly used for debugging rare instances where a Chilkat method call causes a hang or crash, which should generally not happen.

Possible causes of hangs include:

  • A timeout property set to 0, indicating an infinite timeout.
  • A hang occurring within an event callback in the application code.
  • An internal bug in the Chilkat code causing the hang.

More Information and Examples
Example showing how to use DebugLogFilePath.
top
ErrorAction
# intVal is an integer
intVal = charset.get_ErrorAction();
charset.put_ErrorAction(intVal);

Controls what happens when an input character has been decoded successfully but cannot be represented in the destination charset.

ValueAction
0Drop the unrepresentable character.
1Insert the replacement configured by SetErrorString.
2Emit a hexadecimal numeric character reference such as €.
3–5Reserved. Do not use.
6Encode the character using AltToCharset; drop it if that also fails.
7Pass the nonconvertible data through unchanged.
Data-integrity warning: Values 0, 6, and 7 can silently lose data or produce output that is not valid in the declared destination charset. For new code, prefer an explicit failure or replacement policy in the replacement API.

top
FromCharset
# strVal is a string
# ckStr is a CkString
charset.get_FromCharset(ckStr);
strVal = charset.fromCharset();
charset.put_FromCharset(strVal);

Specifies the character encoding of the input bytes for conversion operations. Chilkat decodes the source bytes using this charset before encoding the resulting Unicode text using ToCharset.

FamilyRecognized names
Unicode and ASCIIus-ascii, utf-7, utf-8, unicode / utf-16 / utf-16le, unicodefffe / utf-16be, utf-32, utf-32be
ISO and Windowsiso-8859-1, -2, -3, -4, -5, -6, -7, -8, -9, -13, -15; windows-874, windows-1250 through windows-1258
East Asianshift_jis, gb2312, ks_c_5601-1987, big5, iso-2022-jp, iso-2022-kr, euc-jp, euc-kr
Macintoshmacintosh, x-mac-japanese, x-mac-chinesetrad, x-mac-korean, x-mac-arabic, x-mac-hebrew, x-mac-greek, x-mac-cyrillic, x-mac-chinesesimp, x-mac-romanian, x-mac-ukrainian, x-mac-thai, x-mac-ce, x-mac-icelandic, x-mac-turkish, x-mac-croatian
DOS, IBM, and legacyebcdic, asmo-708, dos-720, dos-862, ibm01140 through ibm01149, ibm037, ibm437, ibm500, ibm737, ibm775, ibm850, ibm852, ibm855, ibm857, ibm00858, ibm860, ibm861, ibm863, ibm864, ibm865, cp866, ibm869, ibm870, cp875, koi8-r, koi8-u
Source encoding: unicode, utf-16, and utf-16le identify little-endian UTF-16. unicodefffe and utf-16be identify big-endian UTF-16. Except where a method explicitly documents HTML metadata detection, set the source charset explicitly rather than assuming automatic detection.

top
LastErrorHtml
# strVal is a string
# ckStr is a CkString
charset.get_LastErrorHtml(ckStr);
strVal = charset.lastErrorHtml();

Provides HTML-formatted information about the last called method or property. If a method call fails or behaves unexpectedly, check this property for details. Note that information is available regardless of the method call's success.

top
LastErrorText
# strVal is a string
# ckStr is a CkString
charset.get_LastErrorText(ckStr);
strVal = charset.lastErrorText();

Provides plain text information about the last called method or property. If a method call fails or behaves unexpectedly, check this property for details. Note that information is available regardless of the method call's success.

More Information and Examples
Concept of LastErrorTextLastErrorText Standard Information
top
LastErrorXml
# strVal is a string
# ckStr is a CkString
charset.get_LastErrorXml(ckStr);
strVal = charset.lastErrorXml();

Provides XML-formatted information about the last called method or property. If a method call fails or behaves unexpectedly, check this property for details. Note that information is available regardless of the method call's success.

top
LastInputAsHex
# strVal is a string
# ckStr is a CkString
charset.get_LastInputAsHex(ckStr);
strVal = charset.lastInputAsHex();

Returns the input bytes captured for the most recent conversion performed while SaveLast was enabled, represented as hexadecimal text.

Diagnostic snapshot: This is a diagnostic representation of the raw bytes. It does not perform another charset conversion, and the quoted-printable form is intended to make otherwise nonprintable bytes easier to inspect.

top
LastInputAsQP
# strVal is a string
# ckStr is a CkString
charset.get_LastInputAsQP(ckStr);
strVal = charset.lastInputAsQP();

Returns the input bytes captured for the most recent conversion performed while SaveLast was enabled, represented as quoted-printable text.

Diagnostic snapshot: This is a diagnostic representation of the raw bytes. It does not perform another charset conversion, and the quoted-printable form is intended to make otherwise nonprintable bytes easier to inspect.

top
LastMethodSuccess
# boolVal is a boolean
boolVal = charset.get_LastMethodSuccess();
charset.put_LastMethodSuccess(boolVal);

Indicates the success or failure of the most recent method call: True means success, False means failure. This property remains unchanged by property setters or getters. This method is present to address challenges in checking for null or Nothing returns in certain programming languages. Note: This property does not apply to methods that return integer values or to boolean-returning methods where the boolean does not indicate success or failure.

top
LastOutputAsHex
# strVal is a string
# ckStr is a CkString
charset.get_LastOutputAsHex(ckStr);
strVal = charset.lastOutputAsHex();

Returns the output bytes captured for the most recent conversion performed while SaveLast was enabled, represented as hexadecimal text.

Diagnostic snapshot: This is a diagnostic representation of the raw bytes. It does not perform another charset conversion, and the quoted-printable form is intended to make otherwise nonprintable bytes easier to inspect.

top
LastOutputAsQP
# strVal is a string
# ckStr is a CkString
charset.get_LastOutputAsQP(ckStr);
strVal = charset.lastOutputAsQP();

Returns the output bytes captured for the most recent conversion performed while SaveLast was enabled, represented as quoted-printable text.

Diagnostic snapshot: This is a diagnostic representation of the raw bytes. It does not perform another charset conversion, and the quoted-printable form is intended to make otherwise nonprintable bytes easier to inspect.

top
SaveLast
# boolVal is a boolean
boolVal = charset.get_SaveLast();
charset.put_SaveLast(boolVal);

When True, retains the input and output byte sequences from each conversion so they can be inspected through LastInputAsHex, LastInputAsQP, LastOutputAsHex, and LastOutputAsQP.

Debugging only: Enable this only while troubleshooting. Retaining both sides of a large conversion increases memory use and may keep sensitive plaintext in memory longer than necessary.

top
ToCharset
# strVal is a string
# ckStr is a CkString
charset.get_ToCharset(ckStr);
strVal = charset.toCharset();
charset.put_ToCharset(strVal);

Specifies the destination character encoding for conversion operations. After decoding the source bytes using FromCharset, Chilkat encodes the resulting Unicode text in this charset.

FamilyRecognized names
Unicode and ASCIIus-ascii, utf-7, utf-8, unicode / utf-16 / utf-16le, unicodefffe / utf-16be, utf-32, utf-32be
ISO and Windowsiso-8859-1, -2, -3, -4, -5, -6, -7, -8, -9, -13, -15; windows-874, windows-1250 through windows-1258
East Asianshift_jis, gb2312, ks_c_5601-1987, big5, iso-2022-jp, iso-2022-kr, euc-jp, euc-kr
Macintoshmacintosh, x-mac-japanese, x-mac-chinesetrad, x-mac-korean, x-mac-arabic, x-mac-hebrew, x-mac-greek, x-mac-cyrillic, x-mac-chinesesimp, x-mac-romanian, x-mac-ukrainian, x-mac-thai, x-mac-ce, x-mac-icelandic, x-mac-turkish, x-mac-croatian
DOS, IBM, and legacyebcdic, asmo-708, dos-720, dos-862, ibm01140 through ibm01149, ibm037, ibm437, ibm500, ibm737, ibm775, ibm850, ibm852, ibm855, ibm857, ibm00858, ibm860, ibm861, ibm863, ibm864, ibm865, cp866, ibm869, ibm870, cp875, koi8-r, koi8-u
Choosing an output encoding: For new text interchange, utf-8 is normally the preferred destination. Legacy single-byte encodings cannot represent every Unicode character; ErrorAction controls how such conversion failures are handled.

top
Utf8
# boolVal is a boolean
boolVal = charset.get_Utf8();
charset.put_Utf8(boolVal);

When set to True, all string arguments and return values are interpreted as UTF-8 strings. When set to False, they are interpreted as ANSI strings.

In Chilkat v11.0.0 and later, the default value is True. Before v11.0.0, it was False.

More Information and Examples
Strings in Python: Encoding, UTF-8, and Source File Format Considerations
top
VerboseLogging
# boolVal is a boolean
boolVal = charset.get_VerboseLogging();
charset.put_VerboseLogging(boolVal);

If set to True, then the contents of LastErrorText (or LastErrorXml, or LastErrorHtml) may contain more verbose information. The default value is False. Verbose logging should only be used for debugging. The potentially large quantity of logged information may adversely affect peformance.

top
Version
# strVal is a string
# ckStr is a CkString
charset.get_Version(ckStr);
strVal = charset.version();

Version of the component/library, such as "10.1.0"

More Information and Examples
How to get the Chilkat version at runtime.
top

Methods

CharsetToCodePage
# charsetName is a string
retInt = charset.CharsetToCodePage(charsetName);

Returns the numeric Windows code-page identifier corresponding to charsetName. For example, iso-8859-1 maps to 28591, and utf-8 maps to 65001.

Code pages: A code page number is a legacy Windows identifier for a character encoding. Internet protocols and modern APIs normally use charset names such as utf-8 rather than numeric code pages.
top
CodePageToCharset
# codePage is an integer
# outCharset is a CkString (output)
status = charset.CodePageToCharset(codePage, outStr);
retStr = charset.codePageToCharset(codePage);

Returns the charset name corresponding to the numeric code-page identifier in codePage. For example, 65001 maps to utf-8. The operation fails when the code page is not recognized.

Name normalization: Different aliases can identify the same encoding. The returned value is Chilkat’s canonical name for the recognized code page, not necessarily the alias originally used by another application.

Returns True for success, False for failure.

top
ConvertFile
# inPath is a string
# destPath is a string
status = charset.ConvertFile(inPath, destPath);

Reads the file at inPath, converts its text from FromCharset to ToCharset, and writes the converted bytes to the file at destPath.

When the destination charset is utf-8 or utf-16, this method writes the corresponding byte-order mark (BOM) at the beginning of the output. Use ConvertFileNoPreamble when the output must not contain a BOM.

BOM behavior: A BOM is a leading byte sequence that can identify a Unicode encoding or byte order. UTF-8 does not require a BOM, and many modern formats prefer UTF-8 without one.

Returns True for success, False for failure.

More Information and Examples
Convert a File's Character Encoding from UTF-8 to UFT-8-BOM
top
ConvertFileNoPreamble
# inPath is a string
# destPath is a string
retBool = charset.ConvertFileNoPreamble(inPath, destPath);

Reads the file at inPath, converts its text from FromCharset to ToCharset, and writes the converted bytes to destPath without adding a byte-order mark or other encoding preamble.

UTF-8 output: This is generally the appropriate choice for UTF-8 files unless the consuming system specifically requires a UTF-8 BOM.
top
ConvertHtmlFile
# inPath is a string
# destPath is a string
status = charset.ConvertHtmlFile(inPath, destPath);

Converts the HTML file at inPath to ToCharset and writes the result to destPath. Chilkat also updates the HTML <meta> charset declaration to identify the destination encoding.

If FromCharset is empty, Chilkat attempts to obtain the source charset from an HTML <meta> declaration. Otherwise, the explicitly configured source charset is used.

Detection limitation: A declared charset is metadata, not proof of the file’s actual encoding. Incorrect or missing declarations can cause decoding errors; use an explicit source charset when it is known.

Returns True for success, False for failure.

top
EntityEncodeDec
# str is a string
# outStr is a CkString (output)
status = charset.EntityEncodeDec(str, outStr);
retStr = charset.entityEncodeDec(str);

Returns str with each non-US-ASCII character replaced by a decimal HTML/XML numeric character reference. For example, é becomes &#233;.

Entity encoding: Numeric character references describe Unicode characters; they are not a character-set conversion and do not make arbitrary binary data safe for HTML.

Returns True for success, False for failure.

top
EntityEncodeHex
# str is a string
# outStr is a CkString (output)
status = charset.EntityEncodeHex(str, outStr);
retStr = charset.entityEncodeHex(str);

Returns str with each non-US-ASCII character replaced by a hexadecimal HTML/XML numeric character reference. For example, é becomes &#xE9;.

Entity encoding: Decimal and hexadecimal numeric references represent the same Unicode character; only the textual notation differs.

Returns True for success, False for failure.

top
GetHtmlFileCharset
# htmlFilePath is a string
# outCharset is a CkString (output)
status = charset.GetHtmlFileCharset(htmlFilePath, outStr);
retStr = charset.getHtmlFileCharset(htmlFilePath);

Examines the HTML file at htmlFilePath and returns the charset name declared by an HTML <meta> element, when present.

Metadata only: The method reads document metadata only. A missing, stale, or incorrect declaration does not reveal the file’s true encoding.

Returns True for success, False for failure.

top
HtmlDecodeToStr
# inStr is a string
# outStr is a CkString (output)
status = charset.HtmlDecodeToStr(inStr, outStr);
retStr = charset.htmlDecodeToStr(inStr);

Decodes HTML named entities and numeric character references in inStr and returns the resulting Unicode string. Examples include &lt;, &amp;, &#233;, and &#xE9;.

Security context: Entity decoding is a text transformation, not HTML parsing or sanitization. Decoding untrusted text can reintroduce markup-significant characters such as <, >, and &.

Returns True for success, False for failure.

top
HtmlEntityDecodeFile
# inPath is a string
# destPath is a string
status = charset.HtmlEntityDecodeFile(inPath, destPath);

Reads the file at inPath, decodes HTML named entities and numeric character references, and writes the transformed content to destPath.

Content transformation: The output may contain literal markup-significant characters that were previously escaped. This operation does not parse, validate, or sanitize HTML.

Returns True for success, False for failure.

top
LowerCase
# inStr is a string
# outStr is a CkString (output)
status = charset.LowerCase(inStr, outStr);
retStr = charset.lowerCase(inStr);

Returns the lowercase form of inStr using Chilkat’s Unicode case conversion.

Unicode casing: Case conversion can change string length and is not the same operation as locale-aware collation or case-insensitive comparison.

Returns True for success, False for failure.

top
ReadFileToString
# path is a string
# charset is a string
# outStr is a CkString (output)
status = charset.ReadFileToString(path, charset, outStr);
retStr = charset.readFileToString(path, charset);

Reads the text file at path, decodes its bytes using the charset named by charset, and returns the resulting Unicode string.

Charset must match the file: The caller must supply the actual source encoding. Choosing the wrong charset can produce replacement characters or silently incorrect text even when the file can be decoded.

Returns True for success, False for failure.

top
SetErrorString
# str is a string
# charset is a string
charset.SetErrorString(str, charset);

Configures the replacement used when ErrorAction is 1. str is the replacement text, and charset identifies the charset used to encode that replacement into the conversion output.

Replacement behavior: Choose replacement text that is representable in the specified charset. A common replacement is ?, but explicit error handling is safer when data loss is unacceptable.
top
UpperCase
# inStr is a string
# outStr is a CkString (output)
status = charset.UpperCase(inStr, outStr);
retStr = charset.upperCase(inStr);

Returns the uppercase form of inStr using Chilkat’s Unicode case conversion.

Unicode casing: Case conversion can change string length and is not the same operation as locale-aware collation or case-insensitive comparison.

Returns True for success, False for failure.

top
UrlDecodeStr
# inStr is a string
# outStr is a CkString (output)
status = charset.UrlDecodeStr(inStr, outStr);
retStr = charset.urlDecodeStr(inStr);

Percent-decodes inStr and interprets the resulting bytes using the platform’s legacy ANSI character encoding.

For example, in a Western Windows code page, %C9 may decode as É. UTF-8 input would encode the same character as %C3%89 and is therefore not handled correctly by this legacy assumption.

Legacy ANSI behavior: Do not use this method for modern URLs or form data unless the data is known to use the applicable ANSI code page. Use StringBuilder URL decoding with an explicit charset, normally utf-8.

Returns True for success, False for failure.

top
VerifyFile
# charset is a string
# path is a string
retBool = charset.VerifyFile(charset, path);

Returns True when the contents of the file at path form a valid byte sequence for the charset named by charset; otherwise returns False.

Validation limitation: A successful result means only that the bytes are structurally valid for that encoding. It does not identify the encoding or confirm that the decoded text is semantically correct.
top
WriteStringToFile
# textData is a string
# path is a string
# charset is a string
status = charset.WriteStringToFile(textData, path, charset);

Encodes the Unicode text in textData using the charset named by charset and writes the resulting bytes to the file at path.

Destination encoding: The charset argument is the third parameter. Select utf-8 for modern interchange unless a receiving system requires a specific legacy encoding.

Returns True for success, False for failure.

top

Deprecated

ConvertData Deprecated
# inData is a CkByteData
# outData is a CkByteData (output)
status = charset.ConvertData(inData, outData);

Converts the bytes in inData from FromCharset to ToCharset and returns the converted bytes.

Returns True for success, False for failure.

top
ConvertFromUnicode Deprecated
# inData is a string
# outBytes is a CkByteData (output)
status = charset.ConvertFromUnicode(inData, outData);

Encodes the Unicode string in inData using ToCharset and returns the resulting bytes.

Returns True for success, False for failure.

top
ConvertFromUtf16 Deprecated
# uniData is a CkByteData
# outMbData is a CkByteData (output)
status = charset.ConvertFromUtf16(uniData, outData);

Converts the UTF-16 byte sequence in uniData to the character encoding specified by ToCharset and returns the resulting bytes.

Returns True for success, False for failure.

top
ConvertHtml Deprecated
# inData is a CkByteData
# outHtml is a CkByteData (output)
status = charset.ConvertHtml(inData, outData);

Converts HTML bytes in inData from FromCharset to ToCharset. The returned bytes contain the converted HTML, and Chilkat updates the HTML <meta> charset declaration to identify the destination encoding.

HTML charset declarations: Updating a <meta charset> declaration does not change HTTP response headers. When serving the converted file over HTTP, the server’s Content-Type charset must agree with the actual bytes.

Returns True for success, False for failure.

top
ConvertToUnicode Deprecated
# inData is a CkByteData
# outStr is a CkString (output)
status = charset.ConvertToUnicode(inData, outStr);
retStr = charset.convertToUnicode(inData);

Decodes the bytes in inData using FromCharset and returns the resulting Unicode string.

Returns True for success, False for failure.

top
ConvertToUtf16 Deprecated
# mbData is a CkByteData
# outUniData is a CkByteData (output)
status = charset.ConvertToUtf16(mbData, outData);

Decodes the bytes in mbData using FromCharset and returns the text encoded as UTF-16 bytes.

Returns True for success, False for failure.

top
GetHtmlCharset Deprecated
# inData is a CkByteData
# outCharset is a CkString (output)
status = charset.GetHtmlCharset(inData, outStr);
retStr = charset.getHtmlCharset(inData);

Examines the HTML bytes in inData and returns the charset name declared by an HTML <meta> element, when present.

Metadata only: This reports the declaration found in the document. It does not verify that the bytes actually use that encoding, and it does not inspect an HTTP Content-Type header.

Returns True for success, False for failure.

top
HtmlEntityDecode Deprecated
# inHtml is a CkByteData
# outData is a CkByteData (output)
status = charset.HtmlEntityDecode(inHtml, outData);

Decodes HTML entities and numeric character references in the byte data supplied in inHtml and returns the resulting bytes.

Operation scope: Entity decoding is not a charset conversion and does not sanitize HTML.

Returns True for success, False for failure.

top
ReadFile Deprecated
# path is a string
# outData is a CkByteData (output)
status = charset.ReadFile(path, outData);

Reads the entire file at path and returns its raw bytes without performing charset conversion.

Returns True for success, False for failure.

top
VerifyData Deprecated
# charset is a string
# inData is a CkByteData
retBool = charset.VerifyData(charset, inData);

Returns True when the bytes in inData form a valid sequence for the charset named by charset; otherwise returns False.

What validation means: This checks encoding validity only. It does not prove that the selected charset is the intended one. For many single-byte encodings, every possible byte value is valid.
top
WriteFile Deprecated
# path is a string
# byteData is a CkByteData
retBool = charset.WriteFile(path, byteData);

Writes all bytes from byteData to the file at path without performing charset conversion.

top