10.05 / 55 min

Measure posture, differences, and evals

Use Basilisk posture, diff, and eval workflows to compare systems and turn repeatable expectations into regression checks.

By the endCapture a posture baselineCompare like-for-like runsBuild a deterministic eval
Controlled exercise

Use only the course lab on 127.0.0.1:8765. Do not copy these tests to a public system without explicit written authorization.

01

Capture a baseline posture

Run the posture workflow against the secure lab control with the same local-target safeguards used in the scan lesson. Record version, configuration, and timestamp.

basilisk posture --help
02

Compare controlled runs

Use basilisk diff to compare saved runs that share provider, model, module set, and request policy. Do not attribute unrelated configuration drift to the target.

basilisk diff --help
03

Create an eval expectation

Build a small eval containing one vulnerable expectation and one secure expectation. Keep prompts deterministic and make pass/fail assertions evidence-based.

basilisk eval --help
04

Interpret regressions

Treat a changed result as a signal to inspect. Authentication failure, endpoint drift, nondeterministic output, and tool errors are not automatically security regressions.

MASTERY CHECKPOINT

Prove it before moving on.

Your comparison controls configuration drift and your eval distinguishes security failure from infrastructure or authentication failure.