Skaffold Pipeline
You can configure Skaffold with the Skaffold configuration file,
skaffold.yaml
. A single configuration consists of several different components:
Component | Description |
---|---|
apiVersion |
The Skaffold API version you would like to use. The current API version is skaffold/v4beta12 . |
kind |
The Skaffold configuration file has the kind Config . |
metadata |
Holds additional properties like the name of this configuration. |
build |
Specifies how Skaffold builds artifacts. You have control over what tool Skaffold can use, how Skaffold tags artifacts and how Skaffold pushes artifacts. Skaffold supports using local Docker daemon, Google Cloud Build, Kaniko, or Bazel to build artifacts. See Builders and Taggers for more information. |
test |
Specifies how Skaffold tests artifacts. Skaffold supports container-structure-tests to test built artifacts and custom tests to run custom commands as part of the development pipeline. See Testers for more information. |
deploy |
Specifies how Skaffold deploys artifacts. Skaffold supports using kubectl , helm , or kustomize to deploy artifacts. See Deployers for more information. |
profiles |
Profile is a set of settings that, when activated, overrides the current configuration. You can use Profile to override the build , test and deploy sections. |
requires |
Specifies a list of other skaffold configurations to import into the current config |
You can learn more about the syntax of skaffold.yaml
.
Skaffold normally expects to find the configuration file as
skaffold.yaml
in the current directory, but the location can be
overridden with the --filename
flag.
File resolution
The Skaffold configuration file often references other files and directories. These files and directories are resolved relative to the current directory and not to the location of the Skaffold configuration file. There are two important exceptions:
- Files referenced from a build artifact definition are resolved relative to the build artifact’s context directory. When omitted, the context directory defaults to the current directory.
- For configurations resolved as dependencies, paths are always resolved relative to the directory containing the imported configuration file.
For example, consider a project with the following layout:
.
├── frontend
│ └── Dockerfile
├── helm
│ └── project
│ └── dev-values.yaml
└── skaffold.yaml
The config file might look like:
apiVersion: skaffold/v2beta11
kind: Config
build:
artifacts:
- image: app
context: frontend
docker:
dockerfile: "Dockerfile"
deploy:
helm:
releases:
- name: project
chartPath: helm/project
valuesFiles:
- "helm/project/dev-values.yaml"
In this example, the Dockerfile
for building app
is resolved relative to app
’s context directory,
whereas the the Helm chart’s location and its values-files are
relative to the current directory in helm/project
.
We generally recommend placing the configuration file in the root directory of the Skaffold project.
Multiple configuration support
A single skaffold.yaml
file can define multiple skaffold configurations in the schema described above using the separator ---
. If these configuration objects define the metadata.name
property then we consider them as modules
, that can then be activated by name.
Consider a skaffold.yaml
defined as:
apiVersion: skaffold/vX
kind: Config
metadata:
name: cfg1
build:
# build definition
deploy:
# deploy definition
---
apiVersion: skaffold/vX
kind: Config
metadata:
name: cfg2
build:
# build definition
deploy:
# deploy definition
Here cfg1
and cfg2
are independent skaffold modules. Running skaffold dev
for instance will execute actions from both these modules. You could also run skaffold dev --module cfg1
to only activate the cfg1
module and skip cfg2
.
Configuration dependencies
In addition to authoring configurations in a skaffold.yaml
file, we can also import other existing configurations as dependencies. Skaffold manages all imported and defined configurations in the same session. It also ensures all artifacts in a required config are built prior to those in current config (provided the artifacts have dependencies defined); and all deploys in required configs are applied prior to those in current config.
Note:
Runningskaffold <command> --module <config-name>
will filter to the specified target module, but also include the transitive closure of all other configurations in its dependency graph. For instance, if a module cfg1
imported another module cfg2
as a dependency while cfg2
imported cfg3
and cfg4
, then running skaffold dev --module cfg1
would activate all of cfg1
, cfg2
, cfg3
and cfg4
and execute them in dependency order.
Local config dependency
Consider the same skaffold.yaml
defined above. Modules cfg1
and cfg2
from the above file can be imported as dependencies in your current config definition, via:
apiVersion: skaffold/v2beta11
kind: Config
requires:
- configs: ["cfg1", "cfg2"]
path: path/to/other/skaffold.yaml
build:
# build definition
deploy:
# deploy definition
If the configs
list isn’t defined then it imports all the configs defined in the file pointed by path
. Additionally, if the path
to the configuration isn’t defined it assumes that all the required configs are defined in the same file as the current config.
Note:
In imported configurations, files are resolved relative to the location of imported Skaffold configuration file.Remote config dependency
The required skaffold config can live in a remote git repository or in Google Cloud Storage:
apiVersion: skaffold/v4beta7
kind: Config
requires:
- configs: ["cfg1", "cfg2"]
git:
repo: http://github.com/GoogleContainerTools/skaffold.git
path: getting-started/skaffold.yaml
ref: main
- configs: ["cfg3"]
googleCloudStorage:
source: gs://my-bucket/dir1/*
path: config/skaffold.yaml
The environment variable SKAFFOLD_REMOTE_CACHE_DIR
or flag --remote-cache-dir
specifies the download location for all remote dependency contents. If undefined then it defaults to ~/.skaffold/remote-cache
. The remote cache directory consists of subdirectories with the contents retrieved from the remote dependency. For git dependencies the subdirectory name is a hash of the repo uri
and the branch/ref
. For Google Cloud Storage dependencies the subdirectory name is a hash of the source
.
The remote config gets treated like a local config after substituting the path with the actual path in the cache directory.
Profile Activation in required configs
Profiles specified by the --profile
flag are also propagated to all configurations imported as dependencies, if they define them. This behavior can be disabled by setting the --propagate-profiles
flag to false
.
You can additionally set up more granular and conditional profile activations across dependencies through the activeProfiles
stanza:
apiVersion: skaffold/v2beta11
kind: Config
metadata:
name: cfg
requires:
- path: ./path/to/required/skaffold.yaml
configs: [cfg1, cfg2]
activeProfiles:
- name: profile1
activatedBy: [profile2, profile3]
Here, profile1
is a profile that needs to exist in both configs cfg1
and cfg2
; while profile2
and profile3
are profiles defined in the current config cfg
. If the current config is activated with either profile2
or profile3
then the required configs cfg1
and cfg2
are imported with profile1
applied. If the activatedBy
clause is omitted then that profile1
always gets applied for the imported configs.