Benchmarks!!! Serialization in Go!!!
Let’s have some fun with some numbers.
In the serialization in go article , we discussed a number of types of encoding formats and their libraries in go.
go-codec: Primer and How To Guide
go-codec is a high performance and feature rich library that provides idiomatic encoding and decoding support for msgpack, binc, cbor, json and simple formats. It supports both runtime introspection (reflection) and code generation. Below, we will walk you through using it for your serialization needs.
Code Generation using go-codec - for 2-20X performance improvement
go-codec supports compile-time generation of encoders and decoders for named types, which does not incur the overhead of reflection in the typical case, giving 40% to 100% performance improvement over the idiomatic runtime introspection mode.
Idiomatic encoding and decoding types within go typically relies on the reflection capabilities of the go runtime. This affords flexible performance without the need for a pre-compilation step; the go types contain all the information needed and the runtime exposes the full types via reflection. However, introspecting the runtime to get this information has a noticeable overhead, which can be eliminated by a pre-compilation/code-generation step.
How go-codec achieves its stellar performance
They say premature optimization is the root of all evil. I say some layers of the stack MUST be optimal. The layer that does marshalling of data MUST be optimal.
go-codec library supports code generation OR runtime reflection for its encoding and decoding. We will mostly discuss the runtime reflection in this article. It is easiest to compare this to other libraries.
go-codec supports cbor? What is a CBOR?
Glad you asked. cbor stands for: Concise Binary Object Representation .
cbor is a relatively new binary format which builds upon the simplicity of messagepack and json. It is currently being targeted agressively in the internet-of-things space. It is a kick-ass format.
Serialization In Go
For data transfer between systems to occur, the sending side must encode the data structures into a stream of bytes, and the receiving side must efficiently decode the stream of bytes into a representative data structure.
There is efficient and extensive support for this when using go as your language runtime. The standard library provides support for the following general-purpose encodings:
Announcing Binc data interchange format
Binc is a lightweight, compact, limitless, schema-free, precise, binary, high-performance, feature-rich, language-independent, multi-domain, extensible, data interchange format for structured data.
See the format documented at http://www.ugorji.net/project/binc
Streamlining Go App Engine Runtime
With App Engine, the Go Runtime is a mashup of Python Runtime, Go SDK and glue code (Go and Python). This poses some challenges during development, which this proposal addresses with solutions.
Dev Tool for GO AppEngine
Development Tool for go app engine development, that presents an easier to use wrapper for App Engine development with GO Runtime, bypassing some pitfalls caused by integration with the Python SDK.
The source is available online, and the motivation for building this is described below. What irks one person may not irk the other, so your utility of this tool may differ from mine. For me, the utility is really high:
GO App Engine datastore operations design
GO App Engine datastore.Load/Save uses goroutines and channels to iterate over datastore entity properties, causing overhead.
Background With GAE 1.6.0, Support for Indexed Properties, Hooks, etc was introduced with a nice, elegant design using a PropertyLoadSaver interface that uses channels (as an iterator).
Testing Go App Engine Applications natively
With changes to allow concurrent requests in Go App Engine, Testing support follows naturally and natively.
Following support for concurrent requests described previously, Testing support is as easy as ensuring the following is called one time before your test is run. I have tested it and it works flawlessly.
Objective Gripes with New Google App Engine Pricing
This attempts to objectively address areas where the new App Engine pricing may not not fair, and what Google may do to alleviate these concerns.
Disclaimer I am an unabashed fan of Google App Engine, and have been for over three years. I don’t think there’s anything else on the market that comes close. I think it is a fine platform for any applications, from simpler small ones to large complex ones.
Google App Engine New Pricing Sucks
Google has done a major disservice to its cult of developers by changing the pricing terms of App Engine ridiculously while giving developers short notice to react. In doing so, Google may have done severe damage to their brand and the trust that developers put in them.
Google released app engine in 2008 on a set of premises:
Android Conversation Backup
This is a post for all my android users out there.
With Android, Google guarantees us that if we ever lose our android phones, we can just grab a new one. Once we sign in with our google account, it automatically syncs our emails, contacts, and applications (including the settings we have for those applications which support this).
The meaning of my name
A while back, I was having an email discussing with one of the men I respect most in this world. All my emails are signed as:
Trying to describe my job at Oracle
I’ve always had a hard time describing what I did at a software company to folks outside software (lawyers, doctors, basketball players, club hoppers, etc). Part of the reason is that I am pretty private and ridiculously modest and overly calculated. However, I was having one of my frustrating days with technology, and someone asked me again to explain, and I just let … said it. Reading the thread later, I am pretty impressed with the description. So I figured I would share.