Correct SHA256 implementation with UTF-8 characters

Marcus Published at Dev

Marcus

I'm running into issues comparing SHA256 hashes generated by different languages/functions.

For example, SHA256("í") either returns:

f3df1f9c358ae8eceb8fce7c00614288d113ad55315f4ebb909774a7daadfc84

-or-

127035a8ff26256ea0541b5add6dcc3ecdaeea603e606f84e0fd63492fbab2c5

Which of the above hash is correct for a string of one character, and what's the correct way of handling UTF-8 strings?

deceze

Which of the above hash is correct for a string of one character

There is no "correct" answer. What's being hashed is the bytes, not the "character". What bytes are hashed exactly depends on the encoding of the string.

"í" in Windows-1252 is byte ED, which hashes as:

f3df1f9c358ae8eceb8fce7c00614288d113ad55315f4ebb909774a7daadfc84

"í" in UTF-8 is bytes C3 AD, which hashes as:

127035a8ff26256ea0541b5add6dcc3ecdaeea603e606f84e0fd63492fbab2c5

"í" in UTF-16LE is bytes ED 00, which hashes as:

430e2ca27910b5ee6e0ec56a12b81325c763376cb8e25a60362dce9444424f95

How exactly that works in various programming languages depends on the languages and the encodings they use for strings.

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at2021-04-10

Comments

0 comments

correct utf-8 characters in phpMyadmin

sha256 implementation in javascript

Is it possible to convert UTF-8 code to the correct characters in R?

Python 3.5.2 - help()-function not showing å,ä,ö (UTF-8 characters) correct

Is this correct way of checking SHA256 on Mac?

C++ openssl SHA256 running slower than JDK SHA256 implementation

How to get correct replacement of ISO-8859-1 characters to UTF-8?

Get SHA256 hash of UTF-16le String

Compare UTF-8 characters

UTF-8 characters in datepicker

UTF-8 to readable characters

UTF-8 characters in nodejs

Implementation of the SHA256 algorithm do not return the expected result

The result of HMAC<Sha256> differs from another implementation

C - SHA256 Generation does not output the correct hash?

Sha256 checksum on terminal displaying strange characters

Convert characters to underscore characters with utf-8

UTF-8 characters with JAXB in Java 8

Correct way to split UTF-8 String

utf8 equivalent not displaying correct

UTF8 correct string length with vardump

SQL datatbase not accepting UTF -8 Characters

PHPMailer and specific characters in subject (UTF-8?)

JPA utf-8 characters not persisted

Java URLDecoder special characters and UTF-8

Handling UTF-8 characters in URLConnection class

Decoding non standard characters to UTF 8 in Python

UTF-8 characters not showing properly in csv

UTF-8 does not print characters to the console

TOP Ranking

Article

Correct SHA256 implementation with UTF-8 characters

Correct SHA256 implementation with UTF-8 characters

pump.io port in URL

How to import an asset in swift using Bundle.main.path() in a react-native native module

Failed to listen on localhost:8000 (reason: Cannot assign requested address)

Inner Loop design for webscrapping

Can't pre-populate phone number and message body in SMS link on iPhones when SMS app is not running in the background

mysql.connector.errors.InterfaceError: 2003: Can't connect to MySQL server on '127.0.0.1:3306' (111 Connection refused)

Removed zsh, but forgot to change shell back to bash, and now Ubuntu crashes (wsl)

ggplotly no applicable method for 'plotly_build' applied to an object of class "NULL" if statements

How to run blender on webserver?

Resetting Value of <input type="time"> in Firefox

Converting a class method to a property with a backing field

Ambiguous use of 'init' with CFStringTransform and Swift 3

Execute ./script.sh with a crontab

How to set tab order for array of cluster,where cluster elements have different data types in LabVIEW?

How to pass data to the ng2-bs3-modal?

Retrieve Element Tag Value XML Using Bash

Spring Boot JPA PostgreSQL Web App - Internal Authentication Error

SQL Server : need add a dot before two last character

Making Array From Page Elements in jQuery

Laravel's ORM sync with timestamps doesn't update timestamps

Do animations stop css changes after animation completion?