Data Serialization in Go
Data Serialization in Go
The Complete Guide to JSON and Other Serialization Formats in Go
About the Book
Strict types, a lack of object-oriented features, and no generics are just some of the limitations that apply to data serialization in Go. Proper and efficient data serialization can be daunting even for the most experienced Go developer. For the newcomer, it's often overwhelming and infuriating.
This book grew out of several years of experience building and maintaining Kivik (https://kivik.io/), the popular CouchDB driver/SDK for Go. In working with CouchDB, which relies heavily on sophisticated manipulation of JSON documents, the author developed several novel techniques and approaches to solve common problems encountered in data serialization.
This work-in-progress book consolidates all of the author's knowledge, research, and tips and tricks on the subject, in a single place.
Table of Contents
- Preface
- Contents
-
Introduction (WIP)
-
What is Data Serialization
- Subtleties
- Serialization is key
- History (TODO)
-
- When the decision has been made for you
- Strengths
- Weaknesses
- Strengths
- Weaknesses
- Strengths
- Weaknesses
- BSON (TODO)
- MessagePack (TODO)
- Smile (TODO)
- Ion (TODO)
- CBOR (TODO)
- XML (TODO)
- Protobuf (TODO)
- CSV (TODO)
- Custom \& proprietary formats (TODO)
-
What is Data Serialization
-
Getting Started with JSON (TODO)
- The encoding/json Package (TODO)
- Marshaling JSON (TODO)
- Unmarshaling JSON (TODO)
- Creating a Custom Marshaler (TODO)
- Creating a Custom Unmarshaler (TODO)
- Relationship to the encoding Package (TODO)
- json.Encoder Options (TODO)
- json.Decoder Options (TODO)
- Streaming Limitations (TODO)
- Best Practices for Readable Serialization Code (TODO)
- Using a Linter (TODO)
-
Data Serialization Toolbox (WIP)
- Pointer vs Value Receivers (TODO)
- The Self-Referencing (Un)Marshaler
- Configurable Marshalers (TODO)
- Validation of input and output (TODO)
- Embedding fields (TODO)
- Internal types (TODO)
- Combining JSON Objects
-
Working with Simple Types (TODO)
- Standard Types (TODO)
- Numbers (TODO)
-
Wrapping Existing Types
- Regular Expressions
- time.Time
- Extending an Embedded Marshaler
- Combining Multiple Structs Into a Single JSON Object
- A Single JSON Object to Multiple Go Structs
-
Streaming JSON Output (WIP)
- Producing an io.Reader from an Object
- Providing a net/http.Request.GetBody Function
- Optimizing for Memory Usage (TODO)
- json.NewEncoder For Shorter Code (TODO)
- Optimizing for Memory Usage (TODO)
- JSON Tokenizer (TODO)
-
Working with YAML (TODO)
- What is YAML (TODO)
- When to use YAML (TODO)
- Converting JSON to YAML (TODO)
- Converting YAML to JSON (TODO)
- What is BSON (TODO)
- When to use BSON (TODO)
- Converting JSON to BSON (TODO)
- Converting BSON to JSON (TODO)
- What is MessagePack (TODO)
- When to use MessagePack (TODO)
- Converting JSON to MessagePack (TODO)
- Converting MessagePack to JSON (TODO)
- What is CBOR (TODO)
- When to use CBOR (TODO)
- Converting JSON to CBOR (TODO)
- Converting CBOR to JSON (TODO)
- What is TOML (TODO)
- When to use TOML (TODO)
- Converting JSON to TOML (TODO)
- Converting TOML to JSON (TODO)
- What is XML (TODO)
- When to use XML (TODO)
- What is ProtoBuf (TODO)
- When to use ProtoBuf (TODO)
- Converting to ProtoBuf (TODO)
- Converting from ProtoBuf (TODO)
- INI (TODO)
- Smile (TODO)
- Comma-Separated Values (CSV) (TODO)
- Custom \& Proprietary Formats (TODO)
-
Related Formats and Concepts (TODO)
- Binary-to-Text: URL Encoding, Base64, Etc (TODO)
- VarInt (TODO)
- MIME (TODO)
- Data Compression (TODO)
-
Third-Party Libraries (TODO)
- github.com/valyala/fastjson (TODO)
- github.com/json-iterator/go (TODO)
- ffjson (TODO)
- Others (TODO)
- Alphabetical Index
The Leanpub 60-day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Do Well. Do Good.
Authors have earned$11,817,855writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
Stratospheric
Tom Hombergs, Björn Wilmsmann, and Philip RiecksFrom Zero to Production with Spring Boot and AWS. All you need to know to get a Spring Boot application into production with AWS. No previous AWS knowledge required.
Go to stratospheric.dev for a tour of the contents.
C++20 - The Complete Guide
Nicolai M. JosuttisAll new language and library features of C++20 (for those who know previous C++ versions).
The book presents all new language and library features of C++20. Learn how this impacts day-to-day programming, to benefit in practice, to combine new features, and to avoid all new traps.
Buy early, pay less, free updates.
Other books:
OpenIntro Statistics
David Diez, Christopher Barr, Mine Cetinkaya-Rundel, and OpenIntroA complete foundation for Statistics, also serving as a foundation for Data Science.
Leanpub revenue supports OpenIntro (US-based nonprofit) so we can provide free desk copies to teachers interested in using OpenIntro Statistics in the classroom and expand the project to support free textbooks in other subjects.
More resources: openintro.org.
node-opcua by example
Etienne RossignonGet the best out of node-opcua through a set of documented examples by the author himself that will allow you to create stunning OPCUA Servers or Clients.
Advanced Web Application Architecture
Matthias NobackThe missing manual for making your web applications future-proof
Jetpack Compose internals
Jorge CastilloJetpack Compose is the future of Android UI. Master how it works internally and become a more efficient developer with it. You'll also find it valuable if you are not an Android dev. This book provides all the details to understand how the Compose compiler & runtime work, and how to create a client library using them.
Ansible for DevOps
Jeff GeerlingAnsible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
R Programming for Data Science
Roger D. PengThis book brings the fundamentals of R programming to you, using the same material developed as part of the industry-leading Johns Hopkins Data Science Specialization. The skills taught in this book will lay the foundation for you to begin your journey learning data science. Printed copies of this book are available through Lulu.
Thinking with Types
Sandy MaguireThis book aims to be the comprehensive manual for type-level programming. It's about getting you from here to there---from a competent Haskell programmer to one who convinces the compiler to do their work for them.
Maîtriser Apache JMeter
Philippe Mouawad, Bruno Demion (Milamber), and Antonio Gomes RodriguesToute la puissance d'Apache JMeter expliquée par ses commiteurs et utilisateurs experts. De l'intégration continue en passant par le Cloud, vous découvrirez comment intégrer JMeter à vos processus "Agile" et Devops.
If you're looking for the newer english version of this book, go to Master JMeter : From load testing to DevOps
Top Bundles
- #1
CCIE Service Provider Ultimate Study Bundle
2 Books
Piotr Jablonski, Lukasz Bromirski, and Nick Russo have joined forces to deliver the only CCIE Service Provider training resource you'll ever need. This bundle contains a detailed and challenging collection of workbook labs, plus an extensively detailed technical reference guide. All of us have earned the CCIE Service Provider certification... - #3
Software Architecture
2 Books
"Software Architecture for Developers" is a practical and pragmatic guide to modern, lightweight software architecture, specifically aimed at developers. You'll learn:The essence of software architecture.Why the software architecture role should include coding, coaching and collaboration.The things that you really need to think about before... - #4
Pattern-Oriented Memory Forensics and Malware Detection
2 Books
This training bundle for security engineers and researchers, malware and memory forensics analysts includes two accelerated training courses for Windows memory dump analysis using WinDbg. It is also useful for technical support and escalation engineers who analyze memory dumps from complex software environments and need to check for possible... - #5
Practical FP in Scala + Functional event-driven architecture
2 Books
Practical FP in Scala (A hands-on approach) & Functional event-driven architecture, aka FEDA, (Powered by Scala 3), together as a bundle! The content of PFP in Scala is a requirement to understand FEDA so why not take advantage of this bundle!? - #10
Cloud Architect: Transform Technology and Organization
2 Books
Architects don't just recite product names and features. They understand the options, decisions, and trade-offs behind them. They earn credibility and maintain authenticity by connecting the penthouse with the engine room. Get two essential books that redefine the role of the software and IT architect at one low price:37 Things One Architect...