In the era of the Internet of Things (IoT), edge computing has become a key paradigm, enabling data to be processed at the point of generation rather than relying on remote cloud servers. This approach supports faster decision- making, reduces bandwidth usage, and enhances privacy. However, edge devices typically operate under strict constraints on processing power, memory, and energy consumption, making them unsuitable for large language models (LLMs), which continue to grow in size and computational demands. Recently, a growing ecosystem of Small Language Models (SLMs) has been introduced, offering lightweight alternatives that bring AI inference to resource-constrained environments by significantly reducing computational cost while remaining suitable for specialization and customization. These resource limitations impose strict requirements on the choice of hardware platform, and it is often unclear which option provides the best balance between performance and efficiency. To address this challenge, this study evaluates the inference performance and energy efficiency of commercial CPUs (Intel and ARM), GPUs (NVIDIA), and NPUs (RaiderChip) for running SLMs. GPUs, known for their parallel processing capabilities, are compared against commercial NPUs and recent multi-core CPUs. While NPUs leverage custom hardware designs to optimize computation, modern CPUs increasingly incorporate dedicated features targeting language model workloads. Using a common execution framework and a suite of state-of-the-art SLMs, we analyze the maximum achievable performance, as well as processing and energy efficiency across commercial solutions available for each platform. The results indicate that specialized backends outperform general-purpose CPUs, with NPUs achieving the highest performance by a wide margin. Bandwidth normalization proves essential for fair cross-architecture comparisons. Although low- power ARM processors deliver competitive results when energy usage is considered, metrics that combine performance and power (such as EDP) again highlight NPUs as the dominant architecture. This shows that designs optimized for both efficiency and performance offer a clear advantage for Edge workloads.