annotate ols/2011/index.html @ 124:41ca6e4a8b6d default tip

Add Ottawa Linux Symposium 2011 and 2012 index pages.
author Rob Landley <rob@landley.net>
date Fri, 26 Jul 2013 15:23:43 -0500
parents
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
124
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
1 <html>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
2 <title>Ottawa Linux Symposium (OLS) papers for 2011</title>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
3 <body>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
4
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
5 <p>Ottawa Linux Symposium (OLS) Papers for 2011:</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
6
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
7 <hr><h2><a href="ols2011-gadre.pdf">X-XEN : Huge Page Support in Xen</a> - A.&nbsp;Gadre, K.&nbsp;Kabra, A.&nbsp;Vasani, K.&nbsp;Darak</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
8
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
9 <p>Huge pages are the memory pages of size 2MB (x86-PAE and x86_64). The
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
10 number of page walks required for translation from a virtual address to
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
11 physical 2MB page are reduced as compared to page walks required for
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
12 translation from a virtual address to physical 4kB page. Also the number
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
13 of TLB entries per 2MB chunk in memory is reduced by a factor of 512 as
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
14 compared to 4kB pages. In this way huge pages improve the performance of
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
15 the applications which perform memory intensive operations. In the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
16 context of virtualization, i.e. Xen hypervisor, we propose a design and
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
17 implementation to support huge pages for paravirtualized guest paging
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
18 operations.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
19
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
20 <p>Our design reserves 2MB pages (MFNs) from the domain's committed memory
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
21 as per configuration specified before a domain boots. The rest of the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
22 memory is continued to be used as 4kB pages. Thus availability of the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
23 huge pages is guaranteed and actual physical huge pages can be provided
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
24 to the paravirtualized domain. This increases the performance of the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
25 applications hosted on the guest operating system which require the huge
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
26 page support. This design solves the problem of availability of 2MB
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
27 chunk in guest's physical address space (virtualized) as well as the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
28 Xen's physical address space which would otherwise may be unavailable
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
29 due to fragmentation.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
30 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
31
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
32 <hr><h2><a href="ols2011-lim.pdf">NPTL Optimization for Lightweight Embedded Devices</a> - Geunsik Lim, Hyun-Jin Choi, Sang-Bum Suh</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
33
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
34 <p></p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
35
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
36 <p>One of the main changes included in the current Linux kernel is that, Linux thread model is transferred from LinuxThread to NPTL\citenptl-design for scalability and high performance. Each thread of user-space allocates one thread (1:1 mapping model) as a kernel for each thread's fast creation and termination. The management and scheduling of each thread within a single process is to take advantage of a multiple processor hardware. The direct management by the kernel thread can be scheduled by each thread. Each thread in a multi-processor system will be able to run simultaneously on a different CPU. In addition, the system service while blocked will not be delayed. In other words, even if one thread calls blocking a system call, another thread is not blocked.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
37
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
38 <p>However, NPTL made features on Linux 2.6 to optimize a server and a desktop against Linux 2.4 dramatically. However, embedded systems are extremely limited on physical resources of the CPU and Memory such as DTV, Mobile phone. Some absences of effective and suitable features for embedded environments needs to be improved to NPTL. For example, the thread's stack size, enforced / arbitrary thread priority manipulation in non-preemptive kernel, thread naming to interpret their essential role, and so on.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
39
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
40 <p>In this paper, a lightweight NPTL (Native POSIX Threads Library) that runs effectively on embedded systems, for the purpose of a way to optimize is described.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
41 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
42
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
43 <hr><h2><a href="ols2011-suzaki.pdf">Analysis of Disk Access Patterns on File Systems for Content Addressable Storage</a> - Kuniyasu Suzaki, Kengo Iijima, Toshiki Yagi, Cyrille Artho</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
44
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
45 <p></p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
46
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
47 <p>CAS (Content Addressable Storage) is virtual disk with deduplication, which merges same-content chunks and reduces the consumption of physical storage. The performance of CAS depends on the allocation strategy of the individual file system and its access patterns (size, frequency, and locality of reference) since the effect of merging depends on the size of a chunk (access unit) used in deduplication.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
48
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
49 We propose a method to evaluate the affinity between file system and CAS, which compares the degree of deduplication by storing many same-contents files throughout a file system. The results show the affinity and semantic gap between the file systems (ext3, ext4, XFS, JFS, ReiserFS (they are bootable file systems), NILFS, btrfs, FAT32 and NTFS, and CAS.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
50
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
51 <p>We also measured disk accesses through five bootable file systems at installation (Ubuntu 10.10) and at boot time, and found a variety of access patterns, even if same contents were installed. The results indicate that the five file systems allocate data scattered from a macroscopic view, but keep block contiguity for data from a microscopic view.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
52 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
53
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
54 <hr><h2><a href="ols2011-lissy1.pdf">Verifications around the Linux kernel</a> - A.&nbsp;Lissy, S.&nbsp;Lauri&egrave;re, P.&nbsp;Martineau</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
55
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
56 <p>Ensuring software safety has always been needed, whether you are designing an on-board aircraft computer or next-gen mobile phone, even if the purpose of the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
57 verification is not the same in both cases. We propose to show the current state
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
58 of the art of work around the verification of the Linux kernel, and by extension
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
59 also present what has been done on other kernels. We will conclude with future
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
60 needs that must be addressed, and some way of improvements that should be
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
61 followed.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
62 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
63
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
64 <hr><h2><a href="ols2011-lissy2.pdf">Faults in Patched Kernel</a> - A.&nbsp;Lissy, S.&nbsp;Lauri&egrave;re, P.&nbsp;Martineau</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
65
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
66 <p>Tools have been designed to detect for faults in the Linux Kernel,
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
67 such as Coccinelle, Sparse, or Undertaker, and studies of their results over the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
68 vanilla tree have been published. We are interested in a specific point: since
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
69 Linux distributions patch the kernel (as other software) and since those patches
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
70 might target less common use cases, it may result in a lower quality assurance
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
71 level and fewer bugs
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
72 found. So, we ask ourselves: is there any difference between upstream and
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
73 distributions' kernel from a faults point of view ? We present an existing tool,
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
74 Undertaker, and detail a methodology for reliably counting bugs in patched and
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
75 non-patched kernel source code, applied to vanilla and distributions'
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
76 kernels (Debian, Mandriva, openSUSE). We show that the difference is negligible
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
77 but in favor of patched kernels.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
78 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
79
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
80 <hr><h2><a href="ols2011-mitake.pdf">Towards Co-existing of Linux and Real-Time OSes</a> - H.&nbsp;Mitake, T-H.&nbsp;Lin, H.&nbsp;Shimada, Y.&nbsp;Kinebuchi, N.&nbsp;Li, T.&nbsp;Nakajima</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
81
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
82 <p>The capability of real-time resource management in the Linux kernel is
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
83 dramatically improving due to the effective contribution of the real-time Linux
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
84 community. However, to develop commercial products cost-effectively,
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
85 it must be possible to re-use existing real-time applications from
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
86 other real-time OSes whose OS API differs significantly from the POSIX
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
87 interface. A virtual machine monitor that executes multiple operating
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
88 systems simultaneously is a promising solution, but existing virtual
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
89 machine monitors such as Xen and KVM are hard to used for embedded
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
90 systems due to their complexities and throughput oriented designs.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
91 In this paper, we introduce a lightweight processor abstraction layer
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
92 named SPUMONE. SPUMONE provides virtual CPUs (vCPUs) for respective guest OSes,
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
93 and schedules them according to their priorities. In a typical case,
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
94 SPUMONE schedules Linux with a low priority and an RTOS with a high priority. The
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
95 important features of SPUMONE are the exploitation of an interrupt
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
96 prioritizing mechanism and a vCPU migration mechanism that
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
97 improves real-time capabilities in order to make the virtualization layer
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
98 more suitable for embedded systems. We also discuss why the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
99 traditional virtual machine monitor design is not appropriate for
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
100 embedded systems, and how the features of SPUMONE allow us to design
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
101 modern complex embedded systems with less efforts.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
102 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
103
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
104 <hr><h2><a href="ols2011-vasavada.pdf"> Comparing different approaches for Incremental Checkpointing: The Showdown </a> - M.&nbsp;Vasavada, F.&nbsp;Mueller, P.&nbsp;Hargrove, E.&nbsp;Roman</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
105
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
106 <p></p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
107
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
108 <p>The rapid increase in the number of cores and nodes in high
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
109 performance computing (HPC) has made petascale computing a reality
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
110 with exascale on the horizon. Harnessing such computational power
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
111 presents a challenge as system reliability deteriorates with the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
112 increase of building components of a given single-unit
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
113 reliability. Today's high-end HPC installations require applications
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
114 to perform checkpointing if they want to run at scale so that failures
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
115 during runs over hours or days can be dealt with by restarting from
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
116 the last checkpoint. Yet, such checkpointing results in high overheads
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
117 due to often simultaneous writes of all nodes to the parallel file
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
118 system (PFS), which reduces the productivity of such systems in terms of
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
119 throughput computing. Recent work on checkpoint/restart (C/R) has shown
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
120 that incremental C/R techniques can reduce the amount of data written
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
121 at checkpoints and thus the overall C/R overhead and impact on the PFS.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
122
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
123 <p>The contributions of this work are twofold. First, it presents the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
124 design and implementation of two memory management schemes that enable
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
125 incremental checkpointing. We describe unique approaches to
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
126 incremental checkpointing that do not require kernel patching in one
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
127 case and only require minimal kernel extensions in the other
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
128 case. The work is carried out within the latest Berkeley Labs
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
129 Checkpoint Restart (BLCR) as part of an upcoming release. Second, we
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
130 evaluate the two schemes in terms of their system overhead for
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
131 single-node microbenchmarks and multi-node cluster workloads. In
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
132 short, this work is the final showdown between page write bit (WB) protection
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
133 and dirty bit (DB) page tracking as a hardware means to support incremental
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
134 checkpointing.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
135 Our results show savings of the DB approach over WB approach in almost
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
136 all the tests. Further, DB has the potential of a significant reduction
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
137 in kernel activity, which is of utmost relevance for proactive fault
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
138 tolerance where an immanent fault can be circumvented if DB-based live
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
139 migrations moves a process away from hardware about to fail.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
140 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
141
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
142 <hr><h2><a href="ols2011-clavis.pdf">User-level scheduling on NUMA multicore systems under Linux</a> - Sergey Blagodurov, Alexandra Fedorova</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
143
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
144 <p>The problem of scheduling on multicore systems remains one of the hottest and the most challenging topics in systems research. Introduction of non-uniform memory access (NUMA) multicore architectures further complicates this problem, as on NUMA systems the scheduler needs not only consider the placement of threads on cores, but also the placement of memory. Hardware performance counters and hardware-supported instruction sampling, available on major CPU models, can help tackle the scheduling problem as they provide a wide variety of potentially useful information characterizing system behavior. The challenge, however, is to determine what information from counters is most useful for scheduling and how to properly obtain it on user level. </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
145
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
146 <p>In this paper we provide a brief overview of user-level scheduling techniques in Linux, discuss the types of hardware counter information that is most useful for scheduling, and demonstrate how this information can be used in an online user-level scheduler. The Clavis scheduler, created as a result of this research , is released as an open source project.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
147 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
148
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
149 <hr><h2><a href="ols2011-vallee.pdf">Management of Virtual Large-scale High-performance Computing Systems</a> - Geoffroy Vall&eacute;e, Thomas Naughton, Stephen L.&nbsp;Scott</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
150
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
151 <p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
152 Linux is widely used on high-performance computing (HPC) systems,
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
153 from commodity clusters to Cray supercomputers (which run the Cray Linux
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
154 Environment). These platforms primarily differ in their system configuration:
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
155 some only use SSH to access compute nodes, whereas others employ full resource
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
156 management systems (e.g., Torque and ALPS on Cray XT systems).
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
157 Furthermore, the latest improvements in system-level virtualization techniques,
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
158 such as hardware support, virtual machine migration for system resilience
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
159 purposes, and reduction of virtualization overheads, enable the usage of
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
160 virtual machines on HPC platforms.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
161
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
162 <p>Currently, tools for the management of virtual machines in the
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
163 context of HPC systems are still quite basic, and often tightly coupled to
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
164 the target platform.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
165 In this document, we present a new system tool for the management of virtual
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
166 machines in the context of large-scale HPC systems, including a run-time
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
167 system and the support for all major virtualization solutions.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
168 The proposed solution is based on two key aspects.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
169 First, Virtual System Environments (VSE), introduced in a previous
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
170 study, provide a flexible method to define the software environment that will
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
171 be used within virtual machines. Secondly, we propose a new system run-time for
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
172 the management and deployment of VSEs on HPC systems, which supports a wide
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
173 range of system configurations. For instance, this generic run-time can
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
174 interact with resource managers such as Torque for the management of virtual
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
175 machines.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
176
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
177 <p>Finally, the proposed solution provides appropriate abstractions to enable
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
178 use with a variety of virtualization solutions on different Linux HPC
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
179 platforms, to include Xen, KVM and the HPC oriented Palacios.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
180
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
181 <hr><h2><a href="ols2011-grekhov.pdf">The Easy-Portable Method of Illegal Memory Access Errors Detection for Embedded Computing Systems</a> - Ekaterina Gorelkina, Alexey Gerenkov, Sergey Grekhov</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
182
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
183 <p></p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
184
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
185 <p> Nowadays applications on embedded systems become more and more complex and require
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
186 more effective facilities for debugging, particularly, for detecting memory access
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
187 errors. Existing tools usually have strong dependence on the architecture of processors
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
188 that makes its usage difficult due to big variety of types of CPUs. In this paper
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
189 an easy-portable solution of problem of heap memory overflow errors detection is
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
190 suggested. The proposed technique uses substitution of standard allocation functions
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
191 for creating additional memory regions (so called \it red zones) for detecting overflows
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
192 and intercepting of page faulting mechanism for tracking memory accesses. Tests have
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
193 shown that this approach allows detecting illegal memory access errors in heap with
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
194 sufficient precision. Besides, it has a small processor-dependent part that makes this
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
195 method easy-portable for embedded systems which have big variety of types of processors.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
196 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
197
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
198 <hr><h2><a href="ols2011-giraldeau.pdf">Recovering System Metrics from Kernel Trace</a> - F.&nbsp;Giraldeau, J.&nbsp;Desfossez, D.&nbsp;Goulet, M. Dagenais, M.&nbsp;Desnoyers</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
199
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
200 <p>Important Linux kernel subsystems are statically instrumented with tracepoints, which enables the gathering of detailed information about a running system, such as process scheduling, system calls and memory management. Each time a tracepoint is encountered, an event is generated and can be recorded to disk for offline analysis. Kernel tracing provides system-wide instrumentation that has low performance impact, suitable for tracing online systems in order to debug hard-to-reproduce errors or analyze the performance.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
201
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
202 <p>Despite these benefits, a kernel trace may be difficult to analyze due to the large number of events. Moreover, trace events expose low-level behavior of the kernel that requires deep understanding of kernel internals to analyze. In many cases, the meaning of an event may depend on previous events. To get valuable information from a kernel trace, fast and reliable analysis tools are required.</p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
203
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
204 <p>In this paper, we present required trace analysis to provide familiar and meaningful metrics to system administrators and software developers, including CPU, disk, file and network usage. We present an open source prototype implementation that performs these analysis with the LTTng tracer. It leverages kernel traces for performance optimization and debugging.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
205 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
206
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
207 <hr><h2><a href="ols2011-masters.pdf">State of the kernel</a> - John C.&nbsp;Masters</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
208
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
209 <p>Slides from the talk follow.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
210 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
211
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
212 <hr><h2><a href="ols2011-riker.pdf">Android Development</a> - Tim&nbsp;Riker</h2>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
213
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
214 <p>Slides from the talk follow.
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
215 </p>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
216
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
217 </body>
41ca6e4a8b6d Add Ottawa Linux Symposium 2011 and 2012 index pages.
Rob Landley <rob@landley.net>
parents:
diff changeset
218 </html>