The most efficient numerical base system

An optimization problem with constraints

Credit per StackExchange.

Assume there are VV independent states of information. Then we can represent approximately VN\frac{V}{N} digits in base NN.

The amount of information we can represent is I=NVNI=N^{\frac{V}{N}}.

The value of NNthat maximizes II (either where the derivative is 00(if the second derivative is negative) or at infinity (if the second derivative is positive)) is the most "efficient" base.

So we take the natural log: ln(I)=VNln(N)\ln(I)=\frac{V}{N}\ln(N)

And take the derivative to NN: (ln(I))=V(1ln(N))N2(\ln(I))^′=V\frac{(1−\ln(N))}{N^2}.

We then set (ln(I))=0(\ln(I))′=0. Solving, N=eN=e.

Take the second derivative: (ln(I))′′=V(2ln(N)3)N3(\ln(I))′′=V\frac{(2\ln(N)−3)}{N^3}

When N=eN=e, (ln(I))′′=Ve3(\ln(I))^{′′}=−\frac{V}{e^3} which is negative (recall that VV is positive), so II reaches its maximum when N=eN=e.

Last updated