aboutsummaryrefslogtreecommitdiff
path: root/NEWS
blob: 766a95a2f461e695ee96bc78d44a626ac5b451c2 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
libhugetlbfs 2.13 "The White Album"
======================================================================
New Features
* Updated man pages
* Added basic events for core_i7 to oprofile_map_events

Bug Fixes
* Fix clean on failure code to avoid closing stdout

Test Suite
* Fixed readahead, malloc, and hugepagesizes tests
* Avoid core dumps on stack_grow_into_huge test

libhugetlbfs 2.13 "Insert Clever Title Here"
======================================================================
New Features
* hugeadm can now be used to control Transparent Huge Page tunables
* New morecore mode to better support THP

Bug Fixes
* Check permissions on hugetlbfs mount point before marking it as available

Test Suite
* Fix shm tests to use random address instead of fixed, old address failed
  on ARM

libhugetlbfs 2.12 "Serrano"
======================================================================
New Features
* libhugetlbfs usage can now be restricted to certain binary names
* lihugetlbfs now supports static linking
* hugeadm uses more human readable directory names for mount points

Bug Fixes
* hugeadm would segfault if specified user was not in passwd, failure in
  getpwuid() is now checked

Test Suite
* Added missing tests to driver script
* Added tests for static linking

libhugetlbfs 2.11 "Ghost Pepper"
======================================================================
New Features
* cpupcstat reports time servicing tlb misses when requested
* When supported by the kernel and glibc, MAP_HUGETLB is used
  for the heap and to back memory returned by get_huge_pages.
  These features can now be used without mounting hugetlbfs

Bug Fixes
* tlbmiss_cost.sh supresses oprofile errors
* numerous fixes to setup_helper.py
* Corrected usage of hugetlbfs_test_feature return value
* find_mounts now correctly ignores non-hugetlbfs mount points
* When prefaulting pages for get_huge_pages readv was using the fd
  for the mapping, this caused the prefault to fail on older libc.
  Now /dev/zero is used for all prefaulting

libhugetlbfs 2.10 "Another Hottie"
======================================================================
Bug Fixes
* hugeadm now handles pool size deltas properly
* Makefile uses ?= to assign PREFIX and EXEDIR to allow for easier build
  modification

libhugetlbfs 2.9 "Something Spicy"
======================================================================
New Features
* Add --no-reseve to hugectl to request mmap'd pages are not reserved
  for kernels newer than 2.6.34
* POWER6 now supported by TLB miss cost estimator
* Add --obey-numa-mempol to hugeadm to request static pool pages are
  allocated following the process NUMA memory policy

Test Suite
* Fix gethugepagesizes test case

libhugetlbfs 2.8 "Scotch Bonnet"
======================================================================
New Features
* Add switch to let administrator limit new mount points by size or inodes
* cpupcstat now caches the value returned by tlmiss_cost.sh to avoid
  rerunning the script

Bug Fixes
* errno values are saved in get_huge_pages
* tlbmiss_cost.sh patches calibrator to fix round naming collision
* Fixed ALIGN_UP macro for aligning huge page segments
* Fix --create-mounts switch in hugeadm
* Library and helpers are all linked with -z noexecstack

Test Suite
* run_tests.py detects valid word sizes

libhugetlbfs 2.7 "Adobo"
======================================================================
New Features
* When specifying huge page pool sizes with hugeadm, memory sizes can
  be used as well as the number of huge pages
* DEFAULT is now a valid huge page pool for resizing, it will adjust
  the pool for the default huge page size
* tlbmiss_cost.sh in the contrib/ sub directory will estimate the cost
  in CPU cycles of a TLB miss on the arch where it is run
* Add python script which automates huge page pool setup with minimal
  input required from user

Bug Fixes
* The --dry-run switch in hugeadm is now obeyed
* hugeadm now uses unsigned long long for page resizes to avoid
  overflow errors
* --set-recommended-shmmax no longer overflows if the number of
  available huge pages is bigger than the address space

Test Suite
* Updated linkhuge_nofd to override proper functions when testing
* run_tests.py can now monitor the pool sizes between tests to help
  identify accounting errors
* Add test for mremap bug on architectures with holes in address space

libhugetlbfs 2.6 "Adovada"
======================================================================
New Features
* cpupcstat now supports data collection using the perf tool as well as
  oprofile
* --explain reports if min_free_kbytes is too small
* add --set-min_free_kbytes to hugeadm

Bug Fixes
* Admin utils (hugeadm, hugectl, etc) are now built as 64 bit binaries
  if possible to support adminstration of larger huge page sizes

Test Suite
* Suppress ld.hugetlbfs warnings during test suite build
* Make SPECIAL keyword test cross-compile safe
* Test script sets proper rlimits for mlock and stack_grow_into_huge
  tests
* Ensure that all elflink tests are run with both HUGETLB_SHARE=0 and
  HUGETLB_SHARE=1

libhugetlbfs 2.5 "Self Titled"
======================================================================
New Features
* added --add-ramdisk-swap option to hugeadm to use ramdisks as
  temporary swap space for diskless systems
* added --persist option to hugeadm to be used with either --add-*-swap
  option.  Makes swap added stay until removed or the machine is rebooted
* added cpupcstat script which uses oprofile to monitor tlb miss rate
  of a target program

Bug Fixes
* --add-temp-swap option now takes an optional integer argument that is
  the size in number of hugepages to make the swap space

libhugetlbfs 2.4 "Birdseye"
======================================================================
New Features
* added --add-temp-swap option to hugeadm to add a swap file for a pool
  resize
* added --[enable|disable]-zone-moveable options to hugeadm to control
  /proc/sys/vm/hugepages_treat_as_movable

Bug Fixes
* Fix pool-pages-max processing by using the proper array for its
  requests
* Move private reservation check out of morecore setup

Test Suite
* Added regression tests for leaking reserve count due to madvise and
  fadvise and readahead
* Add test for mixed permissions on shm segments
* Wrap tests that can hang the machine to fail is kernel is too old
* Add -f option to run_tests.py to force running of tests that can hang
  the machine

libhugetlbfs 2.3 "NuMex Sunglo"
======================================================================
New Features
* added --force-preload option to hugectl for backing segments with
  64kb pages on ppc64 when app was not linked with libhugetlbfs
* added --explain swtich to hugadm to give a quick overview of the
  system wrt huge pages
* hugeadm warns if min pool size is being adjusted without sufficient
  swap space configured
* added --hard switch to ask hugeadm to try multiple times to resize
  a huge page pool
* added --create-*-mounts switches to create mount points for hugetlbfs
  usable by specific users, groups, or globally

Bug Fixes
* hugeadm will no longer mount a directory multiple times
* hugeadm adds all new mount points to /etc/mtab

libhugetlbfs 2.2 "Barkers Extra Hot"
======================================================================
New Features
* Refactored environment variable parsing to read once and store values
* Add --list-mounts and --list-all-mounts options to hugeadm
* Rework test suite to run for all avaialbe page sizes
* Add --create-mounts for root only, --create-user-mounts,
  --create-group-mounts, and --create-global-mounts options to hugeadm
* Add --share-text option to hugectl

Test Suite Fixes
* Added wrapper to shm-fork and shm-getraw tests that makes runs on
  hpage sizes different from default expected failures
* Reworked shmoverride tests to handle new env parsing

libhugetlbfs 2.1 "NM 64"
======================================================================
New Features
* Multiple page size support
* Add a more user friendly allocator that handles cache coloring
* Add pagesize utility to display supported page sizes
* Add hugeadm utility for managing hugepage pools
* Add hugectl utility for running programs using hugepages
* Add hugeedit utility for marking segments in aligned binaries for
  huge page backing by default
* Deprecated linker linker scripts
* gethugepagesize() and getpagesizes() API added to programatically
  discover supported hugepages
* Manual pages for all API functions and utilities
* Allow automatic backing of shared memory segments with hugepages
* huge page regions will no longer prefault for kernels >= 2.6.27
  improving mmap() performance and NUMA layout

Bug Fixes
* Add missing segment to interp section in linker scripts
* Fix free_hugepage_region to handle segments that fell back to small
  pages
* Fix install when lib32 and lib64 resolve to the same place
* Install header files so APIs can be used
* Fix installation paths to make life easier for package maintainers
* Do not export internal symbols unnecessarily
* Prefault regions allocated by direct allocation API on kernels older
  than 2.6.27
* Gracefully fallback to using base pages for text/data when the
  hugepage pool is too small
* Fix handling of HUGETLB_SHARE_PATH environment variable
* Relax remapping requirements

Test suite Fixes
* Added expected failure support
* gethugepagesizes override for getting meminfo
* Increase debug output for tests that fail
* Summarise pass and failure counts

libhugetlbfs 2.0 "Sandia Red"
======================================================================

New Features
* New scriptless relinking for binutils >= 2.17
* Added direct allocator API for huge pages

Bug Fixes
* /proc/mounts is parsed line at a time to handle file larger than 4kb
* Read-only mappings use MAP_NORESERVE

Test suite fixes
* Add test for /proc/mounts file larger than 4kb
* Fix quota test with private reservations
* Output strerror on failure
* linkhuge tests are skipped when known to be broken

libhugetlbfs 1.3 "Big Jim"
======================================================================

New features
* Add HUGETLB_NO_PREFAULT to control prefaulting of huge pages via mlock
* Add "[hostname:pid]" to output messages
* Setup for handling larger huge page sizes e.g. 16G huge pages
* Update for new upstream sysctl
* Add support for hugetlbfs_morecore to shrink the heap

Bug fixes
* Disable heap shrinking by default to avoid bug in glibc malloc
* Skip elflink calls in setup_libhugetlbfs for IA64 and sparc64
* Replace gethugepagesize with check_hugepagesize for error checking
* Make morecore argument a long to handle larger page sizes

Test suite fixes
* Check uid/gid in tests where it matters
* tests: verify there are enough huge pages
* Change tests to read /proc/meminfo
* tests: verify that huge page size isn't too big for the test

libhugetlbfs 1.2 "Mango Habanero"
======================================================================

New features

* Partial segment remapping. This allows non-relinked binaries to try
  to take advantage of libhugetlbfs' segment remapping code. Large
  segments are required, especially on Power. This feature is useful
  for estimating huge page performance, however full relinking will
  still perform better.
* Add extra debugging for binaries that may run out of address space.
* Log library version when HUGETLB_VERBOSE is enabled.
* Beginning support for ia64 and sparc64.
* New test to check handling of misaligned mmap() parameters.

Bug fixes

* Fix EH_FRAME segment. Fixes some C++ applications.
* Rework PLT detection to work better on Power.
* Add per-target-arch syscall stubs to the library. These provide
  reliable error messages from elflink.c if they occur while the
  program segments are unmapped.
* Add proper SONAME to shared libs.
* Makefile respects CFLAGS/LDFLAGS/CPPFLAGS environment variables.
* Make mlock() failure non-fatal.

Test suite fixes

* Fix zero_filesize_segment test.
* Fix the icache-hygeine testcase for i386 and x86_64.
* Fix SEGVs in task-size-overrun test.
* Enable stack_grow_into_huge test, previously skipped.
* Fix test_addr_huge() for anon pages.

libhugetlbfs 1.1 "Carribbean Jerk"
======================================================================

This large release brings several performance improvements

Security

* Remove the sharing daemon completely and rework the segment sharing
  code. Permissions on the hugetlbfs mountpoint are used to enforce
  segment sharing.

Bug fixes

* Sharing of writable segments is no longer possible, due to address
  space randomization on x86_64 (although similar issues could happen on
  any architecture).
* minimal_copy detection should work better in this release.

Trivial but notable changes

* Testcase updates

libhugetlbfs 1.0.1 "Spicy Garlic"
======================================================================

This small maintenance release brings a security fix, a few minor bug
fixes, plus some documentation and error message updates.

Security

* A section on security has been added to the README file
* The hugetlbd daemon socket has been moved from /tmp to /var/run.
  This will require the daemon to be run as root, which was previously
  just a recommendation.

Bug fixes

* Reduce reserved huge pages needed for application start-up
* PPC linker script fixes

Trivial but notable changes

* Always install linker scripts for all targets
* Error message updates
* Add documentation on HUGETLB_DEBUG
* Testcase updates

libhugetlbfs 1.0
======================================================================

* First stable release