No more excuse not to use large pages in Linux

This is a very quick post to remind users of the importance of large pages. Before 11.2.0.2 it was a little more elaborate process to determine the number of large pages to be set aside for Oracle, but now it’s so simple there isn’t any more excuse not to use large pages. If you have > 16G SGA and lots of processes, check the impact of large pages in /proc/meminfo before and after. By implementing large pages at a former company I reduced the page tables overhead from 20G (60G sga, processes set to 1000, most often around 800 sessions connected) to a fraction of that number.

Here is why you can’t hide anymore:

Starting ORACLE instance (normal)
****************** Large Pages Information *****************

Total Shared Global Region in Large Pages = 0 KB (0%)

Large Pages used by this instance: 0 (0 KB)
Large Pages unused system wide = 0 (0 KB) (alloc incr 64 MB)
Large Pages configured system wide = 0 (0 KB)
Large Page size = 2048 KB

RECOMMENDATION:
 Total Shared Global Region size is 20 GB. For optimal performance,
 prior to the next instance restart increase the number
 of unused Large Pages by atleast 10241 2048 KB Large Pages (20 GB)
 system wide to get 100% of the Shared
 Global Region allocated with Large pages
***********************************************************

Now just set vm.nr_hugepages (plus memlock in /etc/security/limits.conf) and off you go!