Fundamentals of Mathematical Statistics by A.C. Gupta and V.K. Kapoor provides a comprehensive introduction to the principles and applications of statistics, covering essential topics such as probability, statistical inference, and estimation.