What is a unicorn?

In venture capital, a unicorn is a privately held startup company that is valued at over $1 billion. It’s a term that’s become common, but where did it come from and why are these companies called unicorns?