From combinatorics to entropy

From combinatorics to entropy:
Let $N=n_1+...+n_k$ and $p_i=\frac{n_i}{N}$.
$$\log (\frac{N!}{n_1!...n_k!})\approx -N\sum _i{p}_i\log p_i$$
by Stirling's formula.

I wonder if this was the first time ever in human history that such an expression $$\sum _i{p}_i\log p_i$$ appeared! Entropy is often too abstract to me. The approximation above is a link between counting combinations and entropy, and it seems to provide the most concrete grasp~
This is the genius of Boltzmann, Maxwell and Gibbs which leads to the development of statistical mechanics.

Energy, entropy, free energy, enthalpy, Legendre transform, etc. are still difficult to understand to me.



Renyi/generalized entropy:
$$D_q=\frac{1}{q-1}\log \sum _i{p}_i^q$$
It is related to the generalized dimension ${\dim }_q(\mu )$ and $L^q$-spectrum $\tau (q):=\underset{r\to 0}{lim inf}\frac{1}{\log r}\log sup\sum _i\mu (B_i{)}^q$:
$${\dim }_q(\mu )=\underset{r\to 0}{lim}\frac{D_q}{\log r}=\frac{\tau (q)}{q-1}.$$