Files
DongHyeonka afbfb1cc73 ci: Trivy 데이터베이스를 runner 캐시에서 복원한다
문제: scripts/ci/trivy-scan.sh가 job마다 취약점 DB(133 MB, 약 30초)를
내려받는다. release 이미지 job은 Java 색인(952 MB, 약 2분)도 받는다. run 125의
이미지 job 7.0분 가운데 약 2.8분이 이 두 내려받기였다.

고른 방법: 새 composite action `.gitea/actions/trivy-db-cache`가 Trivy 기본
캐시 디렉터리(~/.cache/trivy)의 db와 java-db를 actions/cache로 복원한다.
pr.yml `done`, main.yml `vulnerabilities`, release.yml 이미지 job의 scan 앞에
둔다. Java 색인은 이미지 job만 받는다(`java-db: "true"`).
- Trivy는 DB 자체의 metadata로 최신인지 판단하고, 아니면 새로 받는다. 복원은
  시간을 줄일 뿐이고 아는 권고 목록을 바꾸지 않는다.
- 항목은 덮어쓰지 않으므로 key에 기간을 넣는다. 취약점 DB는 하루, Java 색인은
  Trivy가 스스로 3일마다 갱신하므로 3일 단위다. 952 MB가 매일 캐시에 쌓이지 않는다.
- 저장은 main ref만 한다. JDK·Gradle 캐시와 같은 규칙이다. 브랜치가 main이 쓸
  DB를 정하지 못한다.

버린 대안: `--skip-db-update`로 캐시만 쓰기. DB가 오래될 수 있어 게이트가 약해진다.
key 하나 고정. 첫 사본이 영원히 남는다.

위험·한계: Java 색인 항목이 runner 캐시(5 GB 상한)의 약 1 GB를 쓴다. 효과는
main이 한 번 저장한 뒤부터 보인다.

검증: 네 YAML을 읽었다. runner 측정은 PR 본문에 적는다.
2026-11-12 18:56:52 +09:00

148 lines
8.9 KiB
Bash
Executable File

#!/usr/bin/env bash
# Vulnerability gate, shared by the stage workflows. Called by .gitea/workflows/pr.yml and main.yml
# (`filesystem`) and release.yml (`image <reference>`); not by Gradle and not on the desktop, because
# it downloads and installs its tools (docs/work/operate.md 4.1).
#
# bash scripts/ci/trivy-scan.sh filesystem dependency tree: block High/Critical
# vulnerabilities and a forbidden license on a
# shipped dependency (after a build), report the
# rest, fail on any CISA KEV match
# bash scripts/ci/trivy-scan.sh image <reference> release image: write image-sbom.cdx.json,
# block High/Critical vulnerabilities, report
# the rest and the licenses
#
# Tools are pinned release binaries with an asserted SHA-256, installed under RUNNER_TEMP (or a
# temporary directory): a checksum is a supply-chain claim that can be checked offline, an action
# pinned to a commit is not. .trivyignore.yaml is the one suppression source; each entry carries a
# reason and an expiry by policy (.github/dependency-vulnerability-policy.md).
# Optional mirrors: TRIVY_DOWNLOAD_BASE_URL, JQ_DOWNLOAD_BASE_URL, KEV_FEED_URL. The workflows restore
# Trivy's databases into its default cache directory first (.gitea/actions/trivy-db-cache); Trivy
# still downloads a newer one when the restored copy's own metadata says it is out of date.
set -euo pipefail
readonly TRIVY_VERSION='0.71.2'
readonly TRIVY_SHA256_AMD64='0510e71e2fd39bf863856d499c8dc19feb4e7336546394c502a8f5cc7ab27460'
readonly TRIVY_SHA256_ARM64='fe1c7106e15a5365d485b098a8c338f91e3b7ba71cb0e4963b98a3a098763cfc'
readonly JQ_VERSION='1.8.1'
readonly JQ_SHA256_AMD64='020468de7539ce70ef1bceaf7cde2e8c4f2ca6c3afb84642aabc5c97d9fc2a0d'
readonly JQ_SHA256_ARM64='6bc62f25981328edd3cfcfe6fe51b073f2d7e7710d7ef7fcdac28d4e384fc3d4'
readonly DEFAULT_KEV_FEED_URL='https://www.cisa.gov/sites/default/files/feeds/known_exploited_vulnerabilities.json'
cd "$(dirname "${BASH_SOURCE[0]}")/../.."
tools="$(mktemp -d "${RUNNER_TEMP:-/tmp}/trivy-scan.XXXXXX")"
trap 'rm -rf "${tools}"' EXIT
download() { # url, sha256, destination
curl --fail --show-error --silent --location --retry 3 --proto '=https' --tlsv1.2 "$1" --output "$3"
printf '%s %s\n' "$2" "$3" | sha256sum -c -
}
case "$(uname -m)" in
x86_64 | amd64) trivy_arch='64bit'; trivy_sha="${TRIVY_SHA256_AMD64}"; jq_asset='jq-linux-amd64'; jq_sha="${JQ_SHA256_AMD64}" ;;
aarch64 | arm64) trivy_arch='ARM64'; trivy_sha="${TRIVY_SHA256_ARM64}"; jq_asset='jq-linux-arm64'; jq_sha="${JQ_SHA256_ARM64}" ;;
*) echo "trivy-scan: unsupported architecture $(uname -m)" >&2; exit 1 ;;
esac
download "${TRIVY_DOWNLOAD_BASE_URL:-https://github.com/aquasecurity/trivy/releases/download/v${TRIVY_VERSION}}/trivy_${TRIVY_VERSION}_Linux-${trivy_arch}.tar.gz" \
"${trivy_sha}" "${tools}/trivy.tar.gz"
tar -xzf "${tools}/trivy.tar.gz" -C "${tools}" trivy
download "${JQ_DOWNLOAD_BASE_URL:-https://github.com/jqlang/jq/releases/download/jq-${JQ_VERSION}}/${jq_asset}" \
"${jq_sha}" "${tools}/jq"
chmod 0755 "${tools}/trivy" "${tools}/jq"
export PATH="${tools}:${PATH}"
[ "$(jq --version)" = "jq-${JQ_VERSION}" ] || { echo "trivy-scan: unexpected $(jq --version)" >&2; exit 1; }
# A forbidden license on a dependency that ships fails (owner decision 2026-11-11). What ships is
# the default composition's jar, so the gate reads the bootstrap leaf's runtimeClasspath lockfile
# entries. Trivy finds a lockfile's licenses only in the Gradle cache of the same machine; the
# release image scan cannot read a jar's license at all (its Licenses column is empty for every
# jar), and the old separate scan job had no cache, so until the pull-request stage became one job
# that builds first no license gate here had ever seen a license. With no cache this says so and
# skips; with a cache and not one license read, the check would be empty, so it fails.
scan_shipped_licenses() {
local cache="${GRADLE_USER_HOME:-${HOME}/.gradle}/caches/modules-2"
if [ ! -d "${cache}" ]; then
echo "trivy-scan: no Gradle cache at ${cache}; the shipped-license gate runs after a build (pr.yml)"
return 0
fi
local shipped="${tools}/shipped"
mkdir -p "${shipped}"
grep -E '=([^=]*,)?runtimeClasspath(,|$)' src/bootstrap/app/gradle.lockfile > "${shipped}/gradle.lockfile" \
|| { echo "trivy-scan: src/bootstrap/app/gradle.lockfile has no runtimeClasspath entry" >&2; exit 1; }
trivy fs --scanners license --format json --output "${tools}/shipped-licenses.json" "${shipped}"
jq -e '[.Results[]?.Licenses[]?] | length > 0' "${tools}/shipped-licenses.json" > /dev/null \
|| { echo "trivy-scan: Trivy read no license for the shipped dependencies; the gate would be empty" >&2; exit 1; }
trivy fs --scanners license --severity CRITICAL --exit-code 1 --ignorefile .trivyignore.yaml "${shipped}"
}
scan_filesystem() {
trivy fs --scanners vuln --severity CRITICAL,HIGH --exit-code 1 --ignorefile .trivyignore.yaml .
trivy fs --scanners vuln --severity MEDIUM,LOW --exit-code 0 --ignorefile .trivyignore.yaml .
scan_shipped_licenses
# Every other license finding is reported only: the lockfiles also list build tools (SpotBugs,
# Checkstyle, Error Prone) and test libraries that never ship.
trivy fs --scanners license --exit-code 0 --ignorefile .trivyignore.yaml .
trivy fs --scanners vuln --severity CRITICAL,HIGH,MEDIUM,LOW,UNKNOWN --exit-code 0 \
--ignorefile .trivyignore.yaml --format json --output "${tools}/trivy-kev.json" .
# A KEV-listed vulnerability fails regardless of its CVSS score. The feed and the scan are both
# checked for shape first: an empty or malformed input would otherwise intersect to nothing and
# print "no catalog match" for a check that never ran.
if ! curl --fail --show-error --silent --location --retry 3 --proto '=https' --tlsv1.2 \
"${KEV_FEED_URL:-${DEFAULT_KEV_FEED_URL}}" --output "${tools}/kev.json"; then
echo "trivy-scan: KEV feed unavailable; set KEV_FEED_URL to an approved mirror" >&2
exit 1
fi
jq -e '
(.catalogVersion | type == "string" and test("\\S"))
and (.dateReleased | type == "string" and test("\\S"))
and (.count | type == "number")
and (.count > 0)
and (.count == (.count | floor))
and (.vulnerabilities | type == "array")
and ((.vulnerabilities | length) > 0)
and (.count == (.vulnerabilities | length))
and (all(.vulnerabilities[]; (.cveID | type == "string" and test("^CVE-[0-9]{4}-[0-9]{4,}$"))))
and (([.vulnerabilities[].cveID] | unique | length) == .count)
' "${tools}/kev.json" > /dev/null || { echo "trivy-scan: the KEV feed is malformed" >&2; exit 1; }
jq -e '
(type == "object")
and (.Results | type == "array")
and ((.Results | length) > 0)
and (all(.Results[]; type == "object"))
and (all(.Results[]; (.Vulnerabilities == null) or (.Vulnerabilities | type == "array")))
and (all(.Results[]; all(.Vulnerabilities[]?;
(type == "object") and (.VulnerabilityID | type == "string" and test("\\S")))))
' "${tools}/trivy-kev.json" > /dev/null || { echo "trivy-scan: the Trivy KEV input is malformed" >&2; exit 1; }
jq -r '[.Results[]?.Vulnerabilities[]?.VulnerabilityID] | unique[]' "${tools}/trivy-kev.json" | sort -u > "${tools}/found.txt"
jq -r '.vulnerabilities[].cveID' "${tools}/kev.json" | sort -u > "${tools}/kev.txt"
hits="$(comm -12 "${tools}/found.txt" "${tools}/kev.txt")"
if [ -n "${hits}" ]; then
printf 'trivy-scan: CISA KEV-listed vulnerability found regardless of CVSS:\n%s\n' "${hits}" >&2
exit 1
fi
echo "trivy-scan: no KEV catalog match."
}
# The image scan sees the base image's OS packages, which the filesystem scan cannot. The SBOM is
# written before the blocking scan, so the inventory survives the run that refuses to publish.
scan_image() {
trivy image --format cyclonedx --scanners license --output image-sbom.cdx.json "$1"
test -s image-sbom.cdx.json
# Vulnerabilities, OS and application packages alike: High or Critical fails the release. A
# finding with a fix is fixed (a newer base image digest or dependency); one with no fix yet is
# carried in .trivyignore.yaml with its expiry (owner decision 2026-11-11).
trivy image --scanners vuln --severity CRITICAL,HIGH --exit-code 1 --ignorefile .trivyignore.yaml "$1"
trivy image --scanners vuln --severity MEDIUM,LOW --exit-code 0 --ignorefile .trivyignore.yaml "$1"
# Licenses are reported only (same decision): the OS packages' are the distribution's terms, not
# this application's, and Trivy reads no license from a jar in an image. The shipped jars' gate is
# the filesystem scan's (scan_shipped_licenses), which pull requests run after building.
trivy image --scanners license --exit-code 0 --ignorefile .trivyignore.yaml "$1"
}
case "${1:-}" in
filesystem) scan_filesystem ;;
image) scan_image "${2:?image reference}" ;;
*) sed -n '2,13p' "$0" >&2; exit 2 ;;
esac