OSDN Git Service

bpf: Enable task local storage for tracing programs
authorSong Liu <songliubraving@fb.com>
Thu, 25 Feb 2021 23:43:14 +0000 (15:43 -0800)
committerAlexei Starovoitov <ast@kernel.org>
Fri, 26 Feb 2021 19:51:47 +0000 (11:51 -0800)
commita10787e6d58c24b51e91c19c6d16c5da89fcaa4b
tree115e4d7d43d1353084fc3b9e54935aad16c6f821
parent9c8f21e6f8856a96634e542a58ef3abf27486801
bpf: Enable task local storage for tracing programs

To access per-task data, BPF programs usually creates a hash table with
pid as the key. This is not ideal because:
 1. The user need to estimate the proper size of the hash table, which may
    be inaccurate;
 2. Big hash tables are slow;
 3. To clean up the data properly during task terminations, the user need
    to write extra logic.

Task local storage overcomes these issues and offers a better option for
these per-task data. Task local storage is only available to BPF_LSM. Now
enable it for tracing programs.

Unlike LSM programs, tracing programs can be called in IRQ contexts.
Helpers that access task local storage are updated to use
raw_spin_lock_irqsave() instead of raw_spin_lock_bh().

Tracing programs can attach to functions on the task free path, e.g.
exit_creds(). To avoid allocating task local storage after
bpf_task_storage_free(). bpf_task_storage_get() is updated to not allocate
new storage when the task is not refcounted (task->usage == 0).

Signed-off-by: Song Liu <songliubraving@fb.com>
Signed-off-by: Alexei Starovoitov <ast@kernel.org>
Acked-by: KP Singh <kpsingh@kernel.org>
Acked-by: Martin KaFai Lau <kafai@fb.com>
Link: https://lore.kernel.org/bpf/20210225234319.336131-2-songliubraving@fb.com
include/linux/bpf.h
include/linux/bpf_lsm.h
include/linux/bpf_types.h
include/linux/sched.h
kernel/bpf/Makefile
kernel/bpf/bpf_local_storage.c
kernel/bpf/bpf_lsm.c
kernel/bpf/bpf_task_storage.c
kernel/fork.c
kernel/trace/bpf_trace.c