Gitlab CI pipeline tutorial for beginners
Вставка
- Опубліковано 16 чер 2024
- 🚀 Learn GitLab CI in 6 hours - Build & deploy to AWS
www.udemy.com/course/gitlab-c...
YAML configuration used in the video:
gitlab.com/vdespa/my-simple-p...
Video Contents
⌨️ 00:00 Introduction
⌨️ 00:38 New GitLab Project
⌨️ 01:09 Pipeline Definition
⌨️ 03:51 Pipeline Execution
⌨️ 04:59 Job Artifacts
⌨️ 07:00 Conclusion
📬 Connect with Me
X: x.com/vdespa
Medium: / vdespa
Facebook: / valentin-despa-1130381...
LinkedIn: / vdespa
Imprint: vdespa.com/imprint
thank you very much, i didn't know where to start, and like almost always wecan easily drown in the official documentation ... a quick exemple like this is really nice !
Valentin, you really do have an awesome collection of useful, practical and informative videos
Awesome stuff. I really like Gitlab source control over the rest. Smooth easy and functional. Thanks for the tutorial!
Thank you! I like GitLab as well.
Thank you so much, now I understand the artifacts was for.
Thanks for the tutorial, I am wondering whether you can do some of tutorial highlighting different mode of a runner (shell, docker, ssh etc.. ), It will be very helpful.
Regards,
Very helpful and concise tutorial. Thanks!
Very clear explanation !
Thank you!
That's amazing. You bring me to GitLab CI world by a wonderful video. Thank you so much :P
Great tutorial. Easy to understand for beginners.
Great tutorial! Advancing it will be very helpful! Thank you!
such a nice start for gitlab!! thanks
Great video! One thing that I would suggest is to make a different job name from the stage name so the new beginner won't get confused in the first place. Thanks for the good work!
Yes. That is a good suggestion. Thank you for pointing it out.
Really a nice video for the beginners like me. And i also had same suggestion. Keep different names so that it will be more helpful and easier to understand. Thanks.
Thank you! Easy and simple Tutorial, way better then the original documentation :)
Thanks. I am glad it was useful.
Great work!
Thanks you made my day!!
Thnx a lot! I was searching a basic guide how to config autodevops and your explanation help me a lot. Thankyou!
@@vdespa we work with web development in general. I did the config to a project using Laravel.
Well done. Thank you.
Great tutorial and really great job Valentin!
Thank you so much, Mihail. I appreciate you leaving this comment.
Very helpful video, I would like to see more about GitLab CI/CD tutorials from you!
Nice to hear, I plan to use GitLab for developing HTML, CSS, JavaScript and also PHP websites. And that it get pushed to a test to docker with every commitment that happens.
Good for very new guys, thank you
Why are you learning GitLab CI? Write a comment below and let me know.
Thanks a lot! It was useful.
Good video. Thank you
Excellent demonstration of a Simple Gitlab CI Pipeline. Thank you very much.
Glad it was helpful!
Thanks for sharring!
Thanks for sharing. It's useful for me.
Thanks for sharing knowledge..!!
learned something Thanks
good one, thanks!
Simple and easy to follow. Excellent presentation
Thank you, Arock!
Thanks Valentin. Very helpful.
Glad it was helpful!
Great video buddy, thanks!
You are welcome! Thank you for your comment.
Thanks for the great tutorial
You are welcome! Thanks for commenting.
It's useful to give jobs and stages different names so conceptually it's easier to understand, even if your job is "build_job" it clearly marks it as something different from the build stage.
Good Tutorial Thanks!
I am glad it was helpful.
im trying to make this work with an ASP.NET MVC to run of my local 'git runner', however this is the first time that such builds works
thanks... giving me confidence to explore further..
Good luck in getting this to run! 💪
Sick tutorial bro! Thanks 👍
No problem 👍
As they say in German "short but crisp". Good job! Thank you!
Thanks, Babak!
Got me going, thankyou. Next hurdle, to understand different types of Runner, how to choose the right one and build using mvn.
I am glad this helped. I would suggest starting with the Docker runner.
Good job
very helpful, thanks!
Glad to hear. Thanks
Good Job! Thank you!
Thanks 👍
Great video!.. Thanks for Sharing. Is there any video which gives end to end process of integrating Jmeter to Gitlab ? If so could you please share.
Great tuto, tnxs
Thank you! I appreciate that.
Thank you man.
You are welcome!
Amaziiing!
You are welcome. Thank you for leaving a comment.
Thanks a lot, you are amazing
Thanks for watching.
Question: If you install something, via `npm install` or `apt-get`, do you have to remove those installing steps after you run your first job? Or does your pipeline image get regenerated every time it runs? I ask this question because I've seen it done on BitBucket, but it seems to fail on GitLab.
This is great for an amateur!
Thanks
Hi, @Valentin Despa. Thanks for your helpful video. Could you, please, shoot some videos about gitlab api and how to use it correctly?
Hi Eugene. Thanks for your comment. What would you like to do with the GitLab API. Can you give me an example?
nice for start thanks
You're welcome. Let me know what else to cover about Gitlab.
Well done! This is a good explanation.
Glad you think so! Thanks for commenting.
Very nice and clean demo for beginners😀
Glad you liked it!
Thanks for great tutorial for beginners! What tools do you use to add arrows and zoom in while talking?
Thank you for your appreciation! These effects are added in post-production. In macOS you can simply zoom in with cmd + touchpad. You can add arrows or draw with a tool like DemoPro.
Can you somehow share pipelines between components? For example most C++ components will have a cmake && make && make test structure and it wouldn't make sense to have copies of the pipelines en every git repo, but it would make sense to centrilize them.
Thank you good intro! Is there any more advanced examples?
@@vdespa bro i dont have money to pay for course
can you please make same think with specific runner? otherwise create a specific runner with same job. looking to hear from you.
Does the image automatically pulled based on the project type? (e.g php, ruby, JavaScript)
Thank u so much for this guide! It coud be better if u tell about this commands and how it works :)
Thanks 👍 I went into more details on this on my GitLab course. Maybe this would be something for you.
thanks
You are welcome!
Good intro to GitLab CI
I am glad it was helpful, Paul!
Hi, May I how can get the artifacts like application generated logs ?
great
Thanks!
Good tutorial, maybe one thing would be to let people know you're going to be making an example that fails initially. At first I thought I did something wrong and wasted time checking around gitlab to see what happened.
Thanks Ryan. In real life scenarios, you don't know if sometimes will work or fail. But I understood you point.
well first things first, absolutely great video
i'm a beginner in the CI world and I've been documenting myself for several days now, but it's pretty dense; just one question, we didn't write any piece of code to select the image (which i understand as the docker 'file' we are using), so i assume gitlab is smart enough to use one of its shared runners right? which one would it be?
thanks a lot
Great question, Mateo! On Gitlab.com, any job (if not configured differently) will use one of the Gitlab.com shared runners. The shared runner will get the Docker image specified from the public Docker repository (Dockerhub). This is why no code is needed. Even with other Docker runners, this will work the same. Does this clarify your concern?
@@vdespa yes, thanks a lot! but now i have another concern (dont kill me):
i checked it and in my case the runner used the Ruby 2.5 docker image to build our yaml; i'm planning on trying to implement ci in three different projects (arduino/c++, vhdl, c), would these image features be enough to test my code with ci? sorry if i dont concrete more, but as i said im a total beginner and you are helping me a lot :p
@@mateomotriz Hi Mateo. Typically the Ruby 2.5 is the default docker image for the runners. You can specify any Docker image you need. Please refer to my Gitlab CI course which will most likely answer all your questions. Thanks.
@@vdespa thanks a lot!
Hi,in Gitlab i have one stage Deploy i want to build login and push to ACR. how can we tag the latest image everytime i build an image it shld be get it a latest. can u tel me the command.
HI, where does the build directory creates?
Thank you. Can you please make a video on how to run a test from Gitlab on BrowserStack cloud browsers?
thanks for the "kiss"
Can you prepare a video to enable Gitlab Pages in CE 14.5.0 in a fresh setup, it will be really helpful. ( docker or standalone setup anything is fine)
Thank you for you suggestion! I will look into that.
Thanks for the tutorial, however, any idea why the first job hangs on "pending" for me?
@@vdespa yep figured that out already but forgot to edit my comment. Thanks for the reply anyway, great content, keep it up :)
CI /CD option isn't available in my GitLad repo. Any suggestions?
I had to setup a runner for my local installation of gitlab. It took 15 minutes. FYI to those running gitlab locally.
Thanks for letting me know.
hey bro can u teach us that how to run jmeter test plan from gitlab
pleas
gitlab is great... just not sure about security
Valentin, how can you read in a file saved in your computer and use it in your pipeline? Thank you
@@vdespa Is there a method then that I can read that file in my .yml file?
@@vdespa It is just a simple python file that prints Hello World. I am just trying to test that file.
I found more questions like : "where are the directory build and the txtFile to find?" (default runner settings, default gitlab settings)
And could not find any answer from @ValentinDespa. If you do not know, is allright, but pls tell us, in order not to hope to your ansere. Thank you
Hi, the main idea is that you should not care where they are. They are created inside a Docker container which is destroyed after the job is done. This is why, if you want to keep something, you publish this as artifacts.
where is the folder "buiild" create ? I could not find it in the repo
thanks for the tuto but I have an error '' Pulling docker image gitlab/gitlab-runner-helper:x86_64-7f7a4bb0-servercore2004'' failed
can you help me please ?
I recommend using GitLab.com and their shared runners if you are just getting started with pipelines.
How does docker gets involved in this, i did not see any configuration or integration of Docker in this...please help
There is a default Docker image that is used.
so i need to host my webapp before running it in ci cd pipelines or gitlab need to be installed on same server !
@@vdespa no its a question in essence there are only 2000 push/trigger free for self hosted solution correct
How do I publish the project?
When mkdir build is called, where does that directory go? It is not in the rest of my files on gitlab.
@@vdespa yes, thank you.
@@mister_walter_sobchak Thank you
Hi Valentin, Thanks for shearing the video ..... I have one Question .... i am automation Tester (selenium ,core java)and i want to implement CI but i have big numbers of code with Framework, how i will create YAML file please help me out for this concern ,there is some other way to create YAML file? ..Thanks:)
Ajeet
I am not sure I fully understand your question. You need to manually create the file for your projects.
Do you have any video, how to create YAML file for complex automation testing project? Thanks 😊
@@AjeetSingh-ti2yg I recommend taking a look at my course outline. See the link in the video description.
Great tutorial! Do you by any chance know how to integrate Gitlab with Java? my .yml file is configured as below
image: java:latest
stages:
- build
- execute
build:
stage: build
script:
- echo "Building..."
- javac src/Hello.java
artifacts:
paths:
- src/
execute:
stage: execute
script:
- echo "Executing..."
- java src/Hello
I am just uploading a project that says hello world. this program gives me the error that
"could not find or load main class src.Hello". does anyone know what Im doing wrong?
Are you using maven or Gradle?
@@vdespa I didn't choose maven or gradle when i created my intellij project. It's a simple java default program without pom.xml or build.gradle
Make sure you have committed the Hello.java file and that you can see it inside the repository. Try ./src/Hello.java
How to configure .gitlab-ci.yml file in such a way that pipeline gets triggered only on push or merge to master branch? as of now it is getting triggered on any action to every branch.
You can use the only or expect modifier. See docs.gitlab.com/ee/ci/yaml/#onlyexcept-basic
Thank you
How can i deploy Gitlab CI/CD with Jenkins ? Do you have guideline ?
@@vdespa i mean we have once Jenkins server to do build,test,deploy applications with Gitlab, so how can i do it ?
Please post Gitlab ci for AWS also for code deploy
@@vdespa Can we Deploy the build after testing into environments created on AWS?
@@hrudhayd9095 That would be so helpful
Valentin you know resolve this error?
mesg: ttyname failed: Inappropriate ioctl for device
bash: line 55: export: `1=yes': not a valid identifier
ERROR: Job failed: exit status 1
@@vdespa okay, I'll try to figure it out for myself. Thanks for the video.
Hi super starting demo.
Have you infos to create jobs on self hosted gitlab (testing in demo vm currently) for sysadmin bash shell scripts.
I have only à Shell-runner with shellcheck command now and no other test, nor CD tasks.
Wanna go further to make a demo to other admins and some "dev" that near even't don't use basic git or issue management...
@@vdespa i start to use gitlab for shell scripts only currently. (bash), because i don't do dev in other langages now.
I have find only 1 task in ci : shellcheck, a linter.
I'm looking for more tasks to add, in CI or CD, with this case.
Goal : see if i can have more helping tools, even on simple admin shell scripts.
And to make a demo for other users and try convince them to try gitlab, even for small internal projects
Where i am, there is. Many People coding small to medium codes, but without développer methods. Even sometimes without vcs or Issue.... I thnik i could help them
what test -f does? It is bash command? I can run test -f in the terminal, but nothing happends
Yes, test is a Linux command/tool. See linux.die.net/man/1/test
Where do the stages actually run though? I assume these 'build' and 'test' stages are executing code locally in this example but in application this is likely to be done in different environments. How can you tell and configure where these stages run?
The pipeline runs in Docker containers. This has nothing to do with the environments where you deploy the application.
@@vdespa Thanks for the reply. But my question remains.. What are these containers? Does gitlab choose a vanilla linux distro container by default? What if I need a specific container image with dependencies for each stage?
@@SoloSyndicate Yes, they are Linux containers. You can specify one for each job. Have a look at my course, i think you could benefit from it.
can you upload the .yml file in the description?
@@vdespa thanks for the file, can you give us the idea of how to write .yml file for more complex projects please?
@@vdespa such as a python project or a .net project.
@@vdespa if you do then please share the link here.
could you please add deployment to kubernets in this udemy course ?
Thanks for your suggestion. I will look into this.
what if you want 2 pipelines?
@@vdespa yep figured it out,
i have a script for the jenkins pipeline, and a new one for a sonarQ job.
Hay Valentin, thanks for this video, I'm very new to this. As far as I can make out, I've done everything exactly like you've outlined but I get this error each time: echo "Testing"
Testing
$ test -f "build/info.txt"
ERROR: Job failed: exit code 1
This is after I have put the artifact and the token has been generated:
Downloading artifacts for build (257845539)...
Downloading artifacts from coordinator... ok id=257845539 responseStatus=200 OK token=kJFSWduW
$ echo "Testing"
Would you be able to help me figure out why? Thanks!
@@vdespa Thanks for responding. Sharing the pipeline here:
This is the valid yml file, same as yours:
stages:
- build
- test
build:
stage: build
script:
- echo "Building"
- mkdir build
- touch build\info.txt
artifacts:
paths:
- build/
test:
stage: test
script:
- echo "Testing"
- test -f "build/info.txt"
The build that passed:
Running with gitlab-runner 12.1.0-rc1 (6da35412)
on docker-auto-scale ed2dce3a
Using Docker executor with image ruby:2.5 ...
Pulling docker image ruby:2.5 ...
Using docker image sha256:869f833217cc783f4e2bc309d5eb1d194ca980464a0176e2077f03c95eb72991 for ruby:2.5 ...
Running on runner-ed2dce3a-project-13457309-concurrent-0 via runner-ed2dce3a-srm-1563931974-7b01e001...
Fetching changes with git depth set to 50...
Initialized empty Git repository in /builds/Sowmya-Aji/createpipeline/.git/
Created fresh repository.
From gitlab.com/Sowmya-Aji/createpipeline
* [new branch] master -> origin/master
Checking out d82a7011 as master...
Skipping Git submodules setup
$ echo "Building"
Building
$ mkdir build
$ touch build\info.txt
Uploading artifacts...
build/: found 1 matching files
Uploading artifacts to coordinator... ok id=257845539 responseStatus=201 Created token=kJFSWduW
Job succeeded
The test that failed:
Running with gitlab-runner 12.1.0-rc1 (6da35412)
on docker-auto-scale 0277ea0f
Using Docker executor with image ruby:2.5 ...
Pulling docker image ruby:2.5 ...
Using docker image sha256:869f833217cc783f4e2bc309d5eb1d194ca980464a0176e2077f03c95eb72991 for ruby:2.5 ...
Running on runner-0277ea0f-project-13457309-concurrent-0 via runner-0277ea0f-srm-1563933045-a604aa01...
Fetching changes with git depth set to 50...
Initialized empty Git repository in /builds/Sowmya-Aji/createpipeline/.git/
Created fresh repository.
From gitlab.com/Sowmya-Aji/createpipeline
* [new branch] master -> origin/master
Checking out d82a7011 as master...
Skipping Git submodules setup
Downloading artifacts for build (257845539)...
Downloading artifacts from coordinator... ok id=257845539 responseStatus=200 OK token=kJFSWduW
$ echo "Testing"
Testing
$ test -f "build/info.txt"
ERROR: Job failed: exit code 1
Can't figure out where it went wrong. Tried it several times, including deleting the .yml file and doing the whole thing again. :( Would appreciate any insights! :D thank you.
@@vdespa you are awesome. I can't believe I missed that one. Works perfectly now. Thank you so much for caring and helping me!
Would you have a tutorial where the gitlab-ci is running tests on a Docker instance of a website? I've been looking around -- there are examples showing how to run Docker inside the .gitlab-ci.yml file. But I want to run tests, like Selenium for example on a Dockerized instance of a website, like Github or Gitlab itself, and am trying to figure out how to get the yml file to build a Docker instance of a website and run tests on it. It's sort of convoluted! But you make everything sound so simple, I thought I would ask. Thanks!
Hey, you didn’t tell us how to install and configure the Gitlab runner. That’s a crucial step. Maybe it’s in another video. I haven’t explored the channel yet.
Use the shared runners from GitLab. That is the easiest way to get started.
next time take note of gotchas. Pause a bit longer on the working code (6:01). Otherwise good instruction.
Hey. I want to know how to setup pipeline for PHP codeigniter project. looking to hear from you.
I can't get any runner to work... I am on my school's gitlab and we have one shared runner that won't work...
If you are just learning GitLab CI, use the shared runners that GitLab.com offers.