Skip to main content
banner image
venafi logo

What Is Format-Preserving Encryption?

What Is Format-Preserving Encryption?

what-is-format-preserving-encryption
January 25, 2021 | Anastasios Arampatzis

Format-Preserving Encryption (FPE) encrypts the plaintext of some specified format, such as a Social Security or credit card number, into a ciphertext while preserving the original formatting of the plaintext.

The problem of protecting data in legacy systems

The protection of data in legacy systems, such as the ones used in banking and healthcare systems, is a problem that needs to be addressed in such a way that does not interfere with the operation of these systems. 

The problem lies on the fact that encrypting this formatted data using, for example, the Advanced Encryption Standard (AES) CBC mode, a 16-digit value that represents a credit-card number might be encrypted to a string such as BfA1lytW8I2kflOcQbOCUlX1yH+vAL1/nRoLgKkId+o=. This is longer than 16 characters, and most of the string is no longer digits. Unfortunately, this sort of change can be fatal in complex legacy environments, where lots of applications expect to get only 16-digit values and may not fail gracefully if they do not get it.

How FPE solves the problem

NIST describes a solution to this problem in their recent Special Publication 800-38G, "Recommendation for Block Cipher Modes of Operation: Methods for Format-Preserving Encryption."

The FPE modes specified by SP 800-38G allow the encryption plaintext without changing the format. FPE methods are designed for data that is not necessarily binary. NIST explains that “given any finite set of symbols, like the decimal numerals, a method for FPE transforms data that is formatted as a sequence of the symbols in such a way that the encrypted form of the data has the same format, including the length, as the original data. Thus, an FPE-encrypted SSN would be a sequence of nine decimal digits.”

SP 800-38G specifies ways to encrypt sensitive data that can be fully validated to FIPS 140-2, the US government's "Security Requirements for Cryptographic Modules." FPE modes described in NIST SP 800-38G can be used to protect sensitive data while maintaining compliance with data privacy and security regulations, such as CCPA, HIPAA, PCI DSS, or GDPR.

The NIST SP 800-38G was initially published in 2016 and described two modes for FPE: FF1, and FF3. In 2017, researchers performed a cryptanalytic attack on FF3, rendering it unsuitable for general-purpose FPE because it did not achieve the intended 128-bit security level.

In response to the attack, NIST updated FF3 to FF3-1 in early 2019. The update addressed potential vulnerabilities where the number of possible inputs—that is, the domain size—is sufficiently small, for example, using the middle six digits of credit card or Social Security numbers. In these cases, there is simply not enough entropy to create a secure output that cannot be reverse engineered. In the original SP 800-38G, the domain size for FF1 and FF3 was required to be at least 100 and recommended to be at least 1,000,000. In the revision, the domain size is required to be 1,000,000.

Benefits of FPE

FPE modes facilitate the retrofitting of encryption technology to existing devices or software, where a conventional encryption mode might not be feasible. In particular, database applications may not support changes to the length or format of data fields.

This is why FPE is commonly used to protect sensitive data sets, such as payment card data, bank account details, Social Security Numbers and personally identifiable information (PII), that are processed and stored in retail, healthcare and financial databases and applications.

More generally, FPE can support the “sanitization” of databases, the use of encryption to personally identifiable information (PII), such as SSNs.  The encrypted SSNs could still serve as an index to facilitate statistical research, even across multiple databases. This means a lot of processing of FPE-encrypted data can be performed with the data in its protected state.

FPE vs. tokenization

Similar approach to FPE for format-preserving data protection is the use of tokenization. Tokenization exchanges sensitive data with randomized values in the same format that has no intrinsic value of its own. The original data is stored in a secure data vault. However, tokenization is not the same as encryption. Encrypted data can be decrypted with the appropriate keys, or machine identities. On the other hand, tokens cannot be reversed because there is no mathematical relationship between the token and its original value. This means there is greater flexibility with the breadth of tokens the data can be converted to.

Conclusion

Data protection is important to ensure compliance with the various security and privacy regulations and avoid costly penalties. However, organizations should assess the various encryption methods to ensure that their critical systems are not disrupted when processing ciphertexts. Either way, organizations should protect encryption keys from compromise. Data encryption and protection is as strong as the strength of associated keys. Once the keys are compromised, all encrypted data can be deciphered by cyber criminals, exposing business and individuals to threats such as financial fraud, blackmail, impersonation, and business email compromise.

Are any of your organizations machine identities exposed?


Related posts


Learn more about machine identity management.

Like this blog? We think you will love this.
image representing big data
Featured Blog

Le chiffrement homomorphe : Définition et utilisation

Qu'est-ce que le chiffrement homomorphe ? Le

Read More
Subscribe to our Weekly Blog Updates!

Join thousands of other security professionals

Get top blogs delivered to your inbox every week

See Popular Tags

You might also like

TLS Machine Identity Management for Dummies
eBook

TLS Machine Identity Management for Dummies

Certificate-Related Outages Continue to Plague Organizations
White Paper

CIO Study: Certificate-Related Outages Continue to Plague Organizations

About the author

Anastasios Arampatzis
Anastasios Arampatzis

Anastasios Arampatzis is a retired Hellenic Air Force officer with over 20 years of experience in evaluating cybersecurity and managing IT projects. He works as an informatics instructor at AKMI Educational Institute, while his interests include exploring the human side of cybersecurity.

Read Posts by Author
get-started-overlay close-overlay cross icon
get-started-overlay close-overlay cross icon
Venafi Risk assessment Form Image

Sign up for Venafi Cloud


Venafi Cloud manages and protects certificates



* Please fill in this field Please enter valid email address
* Please fill in this field Password must be
At least 8 characters long
At least one digit
At last one lowercase letter
At least one uppercase letter
At least one special character
(@%+^!#$?:,(){}[]~`-_)
* Please fill in this field
* Please fill in this field
* Please fill in this field
*

End User License Agreement needs to be viewed and accepted



Already have an account? Login Here

×
get-started-overlay close-overlay cross icon

How can we help you?

Thank you!

Venafi will reach out to you within 24 hours. If you need an immediate answer please use our chat to get a live person.

In the meantime, please explore more of our solutions

Explore Solutions

learn more

Email Us a Question

learn more

Chat With Us

learn more