{"id":49537,"date":"2025-05-28T06:36:31","date_gmt":"2025-05-28T06:36:31","guid":{"rendered":"https:\/\/www.devopsschool.com\/blog\/?p=49537"},"modified":"2025-05-28T08:45:49","modified_gmt":"2025-05-28T08:45:49","slug":"gitlab-top-30-gitlab-pipeline-automation-questions-answers","status":"publish","type":"post","link":"https:\/\/www.devopsschool.com\/blog\/gitlab-top-30-gitlab-pipeline-automation-questions-answers\/","title":{"rendered":"Gitlab – Top 30 GitLab Pipeline Automation FAQ"},"content":{"rendered":"\n

Here’s a curated set of 30 most frequently asked real-world questions<\/strong> about GitLab CI\/CD pipeline automation<\/strong>, with clear and concise answers \u2014 perfect for training sessions or real-world use:<\/p>\n\n\n\n

\n\n\n\n

\u2705 Top 30 GitLab Pipeline Automation Questions & Answers<\/strong><\/h3>\n\n\n\n
\n\n\n\n

1. What is the difference between needs<\/code> and dependencies<\/code> in GitLab CI?<\/strong><\/h4>\n\n\n\n
    \n
  • needs<\/code>: Controls execution order (jobs run as soon as dependencies finish), enables parallelism.<\/li>\n\n\n\n
  • dependencies<\/code>: Controls artifact download but doesn\u2019t affect execution order.<\/li>\n<\/ul>\n\n\n\n
    \n\n\n\n

    2. Can a single job be reused in multiple stages?<\/strong><\/h4>\n\n\n\n
      \n
    • No, a job can only belong to one stage. You can replicate logic using YAML anchors or templates.<\/li>\n<\/ul>\n\n\n\n
      \n\n\n\n

      3. How to conditionally run a job only for merge requests?<\/strong><\/h4>\n\n\n
      rules:\n  - if<\/span>: '$CI_PIPELINE_SOURCE == \"merge_request_event\"'<\/span>\n<\/code><\/span>Code language:<\/span> JavaScript<\/span> (<\/span>javascript<\/span>)<\/span><\/small><\/pre>\n\n\n
      \n\n\n\n
      4. How to run jobs only on a specific branch like main<\/code> or dev<\/code>?<\/strong><\/h4>\n\n\n
      only:\n  - main\n<\/code><\/span><\/pre>\n\n\n
      Or use:<\/p>\n\n\n
      rules:\n  - if<\/span>: '$CI_COMMIT_BRANCH == \"main\"'<\/span>\n<\/code><\/span>Code language:<\/span> JavaScript<\/span> (<\/span>javascript<\/span>)<\/span><\/small><\/pre>\n\n\n
      \n\n\n\n
      5. How to cache dependencies between jobs?<\/strong><\/h4>\n\n\n
      cache:\n  paths:\n    - node_modules\/\n<\/code><\/span><\/pre>\n\n\n
      \n\n\n\n
      6. How to share artifacts between jobs?<\/strong><\/h4>\n\n\n\n
      Use artifacts<\/code> and dependencies<\/code>:<\/p>\n\n\n
      job1<\/span>:\n  script<\/span>: make<\/span> build<\/span>\n  artifacts<\/span>:\n    paths<\/span>: [build\/]<\/span>\n\njob2<\/span>:\n  script<\/span>: deploy<\/span>\n  dependencies<\/span>: [job1]<\/span>\n<\/code><\/span>Code language:<\/span> CSS<\/span> (<\/span>css<\/span>)<\/span><\/small><\/pre>\n\n\n
      \n\n\n\n
      7. How to trigger another project\u2019s pipeline?<\/strong><\/h4>\n\n\n
      trigger:\n  project: my-group\/another-project\n  branch: main\n<\/code><\/span><\/pre>\n\n\n
      \n\n\n\n
      8. How to create a manual approval job in a pipeline?<\/strong><\/h4>\n\n\n
      when<\/span>: manual\n<\/code><\/span>Code language:<\/span> HTTP<\/span> (<\/span>http<\/span>)<\/span><\/small><\/pre>\n\n\n
      \n\n\n\n
      9. How to run a job only when a tag is pushed?<\/strong><\/h4>\n\n\n
      only:\n  - tags\n<\/code><\/span><\/pre>\n\n\n
      \n\n\n\n
      10. Can we define multiple .gitlab-ci.yml<\/code> files?<\/strong><\/h4>\n\n\n\n
        \n
      • Yes, use the include:<\/code> keyword to import local, remote, or project-specific YAML files.<\/li>\n<\/ul>\n\n\n\n
        \n\n\n\n
        11. How to define environment-specific jobs (dev, staging, prod)?<\/strong><\/h4>\n\n\n
        rules:\n  - if<\/span>: '$CI_ENVIRONMENT_NAME == \"staging\"'<\/span>\n<\/code><\/span>Code language:<\/span> JavaScript<\/span> (<\/span>javascript<\/span>)<\/span><\/small><\/pre>\n\n\n
        \n\n\n\n
        12. How to use custom variables in GitLab CI?<\/strong><\/h4>\n\n\n\n
        Define in UI or .gitlab-ci.yml<\/code>:<\/p>\n\n\n
        variables:\n  DEPLOY_ENV: \"prod\"<\/span>\n<\/code><\/span>Code language:<\/span> JavaScript<\/span> (<\/span>javascript<\/span>)<\/span><\/small><\/pre>\n\n\n
        \n\n\n\n
        13. How to use matrix builds in GitLab?<\/strong><\/h4>\n\n\n
        parallel<\/span>:\n  matrix<\/span>:\n    -<\/span> VARIANT<\/span>: [debug, release]<\/span>\n<\/code><\/span>Code language:<\/span> CSS<\/span> (<\/span>css<\/span>)<\/span><\/small><\/pre>\n\n\n
        \n\n\n\n
        14. How to run a job only if certain files changed?<\/strong><\/h4>\n\n\n
        rules<\/span>:\n  -<\/span> changes<\/span>:\n      -<\/span> src<\/span>\/**\/<\/span>*\n<\/code><\/span>Code language:<\/span> CSS<\/span> (<\/span>css<\/span>)<\/span><\/small><\/pre>\n\n\n
        \n\n\n\n
        15. How to skip pipeline for a commit?<\/strong><\/h4>\n\n\n\n
        Use [ci skip]<\/code> in commit message.<\/p>\n\n\n\n
        \n\n\n\n
        16. What is allow_failure: true<\/code> used for?<\/strong><\/h4>\n\n\n\n
        It lets a job fail without failing the whole pipeline.<\/p>\n\n\n\n
        \n\n\n\n
        17. How to handle secrets or credentials securely?<\/strong><\/h4>\n\n\n\n
        Store them as CI\/CD variables in GitLab UI (masked and protected if needed).<\/p>\n\n\n\n
        \n\n\n\n
        18. What is the purpose of before_script<\/code> and after_script<\/code>?<\/strong><\/h4>\n\n\n\n
          \n
        • before_script<\/code>: runs before the main job script.<\/li>\n\n\n\n
        • after_script<\/code>: runs after the main job script (even on failure).<\/li>\n<\/ul>\n\n\n\n
          \n\n\n\n
          19. How to make a job retry on failure?<\/strong><\/h4>\n\n\n
          retry<\/span>: 2\n<\/code><\/span>Code language:<\/span> HTTP<\/span> (<\/span>http<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          20. What is artifacts:expire_in<\/code> used for?<\/strong><\/h4>\n\n\n\n
          Sets how long GitLab retains the artifact:<\/p>\n\n\n
          artifacts:\n  expire_in: 1 week\n<\/code><\/span><\/pre>\n\n\n
          \n\n\n\n
          21. What is the role of stages<\/code> in GitLab CI?<\/strong><\/h4>\n\n\n\n
          Defines the pipeline flow. Jobs in the same stage run in parallel; stages run sequentially.<\/p>\n\n\n\n
          \n\n\n\n
          22. How to conditionally run a job on a variable value?<\/strong><\/h4>\n\n\n
          rules:\n  - if<\/span>: '$DEPLOY_ENV == \"prod\"'<\/span>\n<\/code><\/span>Code language:<\/span> JavaScript<\/span> (<\/span>javascript<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          23. How to disable a job temporarily?<\/strong><\/h4>\n\n\n\n
          Add:<\/p>\n\n\n
          when<\/span>: never\n<\/code><\/span>Code language:<\/span> HTTP<\/span> (<\/span>http<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          24. How to run a job only when another job fails?<\/strong><\/h4>\n\n\n
          when<\/span>: on_failure\n<\/code><\/span>Code language:<\/span> HTTP<\/span> (<\/span>http<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          25. How to visualize job dependencies (DAG)?<\/strong><\/h4>\n\n\n\n
          Use needs:<\/code> to define dependencies and GitLab will show it in pipeline graph view.<\/p>\n\n\n\n
          \n\n\n\n
          26. Can you trigger child pipelines?<\/strong><\/h4>\n\n\n\n
          Yes, using:<\/p>\n\n\n
          trigger<\/span>:\n  include<\/span>: child-pipeline<\/span>.yml<\/span>\n<\/code><\/span>Code language:<\/span> CSS<\/span> (<\/span>css<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          27. How to control concurrency in pipelines?<\/strong><\/h4>\n\n\n\n
          Use resource_group:<\/code> to ensure mutual exclusion:<\/p>\n\n\n
          resource_group<\/span>: deploy-prod\n<\/code><\/span>Code language:<\/span> HTTP<\/span> (<\/span>http<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          28. How to limit job execution time?<\/strong><\/h4>\n\n\n
          timeout<\/span>: 15 minutes\n<\/code><\/span>Code language:<\/span> HTTP<\/span> (<\/span>http<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          29. How to use GitLab CI templates (SAST, DAST, etc.)?<\/strong><\/h4>\n\n\n
          include<\/span>:\n  - template: Security\/SAST.gitlab-ci.yml\n<\/code><\/span>Code language:<\/span> PHP<\/span> (<\/span>php<\/span>)<\/span><\/small><\/pre>\n\n\n
          \n\n\n\n
          30. How to pass data between jobs?<\/strong><\/h4>\n\n\n\n
          Use:<\/p>\n\n\n\n
            \n
          • artifacts<\/code> (for file data)<\/li>\n\n\n\n
          • cache<\/code> (for shared folders)<\/li>\n\n\n\n
          • CI\/CD variables<\/code> (for text\/values)<\/li>\n<\/ul>\n\n\n\n
            \n\n\n\n
            31 To copy artifacts from two separate jobs into a single common directory<\/strong>, you need to follow these steps in GitLab CI\/CD:<\/h2>\n\n\n\n
            Combine artifacts from job1<\/code> and job2<\/code> into a common directory in job3<\/code>.<\/p>\n\n\n
            stages:\n  - build\n  - merge\n\njob1:\n  stage: build\n  script:\n    - echo<\/span> \"Job 1 output\"<\/span> > job1.txt\n  artifacts:\n    paths:\n      - job1.txt\n\njob2:\n  stage: build\n  script:\n    - echo<\/span> \"Job 2 output\"<\/span> > job2.txt\n  artifacts:\n    paths:\n      - job2.txt\n\njob3:\n  stage: merge\n  needs:\n    - job: job1\n      artifacts: true<\/span>\n    - job: job2\n      artifacts: true<\/span>\n  script:\n    - mkdir merged\n    - cp job1.txt merged\/\n    - cp job2.txt merged\/\n    - ls -la merged\n  artifacts:\n    paths:\n      - merged\/\n<\/code><\/span>Code language:<\/span> PHP<\/span> (<\/span>php<\/span>)<\/span><\/small><\/pre>\n\n\n
            32 .<\/h2>\n\n\n\n
            To copy artifacts from two jobs into a common directory in GitLab CI, you can use artifacts<\/code><\/strong> along with the dependencies<\/code><\/strong> or needs<\/code><\/strong> keyword to make artifacts available to a third job that merges them.<\/p>\n\n\n\n
            \u2705 Goal:<\/h3>\n\n\n\n
            You have:<\/p>\n\n\n\n
              \n
            • job1<\/code> and job2<\/code> that create artifacts<\/li>\n\n\n\n
            • merge_job<\/code> that collects them into a shared directory (e.g., merged-artifacts\/<\/code>)<\/li>\n<\/ul>\n\n\n\n
              \n\n\n\n
              \u2705 Example .gitlab-ci.yml<\/code><\/h3>\n\n\n
              stages:\n  - build\n  - merge\n\njob1:\n  stage: build\n  script:\n    - echo<\/span> \"Job 1 output\"<\/span> > file1.txt\n  artifacts:\n    paths:\n      - file1.txt\n\njob2:\n  stage: build\n  script:\n    - echo<\/span> \"Job 2 output\"<\/span> > file2.txt\n  artifacts:\n    paths:\n      - file2.txt\n\nmerge_job:\n  stage: merge\n  needs: [job1, job2]\n  script:\n    - mkdir -p merged-artifacts\n    - cp job1\/file1.txt merged-artifacts\/\n    - cp job2\/file2.txt merged-artifacts\/\n    - echo<\/span> \"Merged artifacts:\"<\/span>\n    - ls -l merged-artifacts\n  dependencies:\n    - job1\n    - job2\n  artifacts:\n    paths:\n      - merged-artifacts\/\n<\/code><\/span>Code language:<\/span> PHP<\/span> (<\/span>php<\/span>)<\/span><\/small><\/pre>\n\n\n
              \n\n\n\n
              <\/p>\n","protected":false},"excerpt":{"rendered":"
              Here’s a curated set of 30 most frequently asked real-world questions about GitLab CI\/CD pipeline automation, with clear and concise answers \u2014 perfect for training sessions or real-world use: \u2705… <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_joinchat":[],"footnotes":""},"categories":[2],"tags":[],"class_list":["post-49537","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"_links":{"self":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/49537","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/comments?post=49537"}],"version-history":[{"count":4,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/49537\/revisions"}],"predecessor-version":[{"id":49554,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/49537\/revisions\/49554"}],"wp:attachment":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/media?parent=49537"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/categories?post=49537"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/tags?post=49537"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}