-
Suggestion
-
Resolution: Deployed
-
Our product teams collect and evaluate feedback from a number of different sources. To learn more about how we use customer feedback in the planning process, check out our new feature policy.
Hello
I would love to see a bitbucket pipelines agent provided, similar to the gitlab-runner go agent, which users could run on-prem, or inside secure networks.
The agent would register with the cloud, and we could specify which agent(s) pipelines could run against. When the agent runs, it polls the cloud for jobs to process.
Note that this would remove the need to provide support for BCLOUD-12753.
Thanks
[BCLOUD-16995] Bitbucket Pipelines agent for on-prem pipeline actions
สล็อต ฝาก10รับ100 ทำยอด200 ** เว็บแจกเครดิตฟรี 200 แค่สมัคร ไม่ต้องลงทุนเยอะ สมัครฟรีกับ SLOT WALLET เว็บอันดับ 1 ของไทย
Is there a plan to expand the architectures supported to support ARM linux? We cannot use pipelines at the moment since our builds and tests need to run on ARM.
It would also be nice if the system requirements were lower so we could use some of our embedded systems as runners for certain testing. They are just quad core ARM with 2GB of RAM.
Will this allow us to do pipelines with the correct docker flags to build and run arm containers?
https://jira.atlassian.com/browse/BCLOUD-15317
@LeeHull it's in the first line of the docs page https://support.atlassian.com/bitbucket-cloud/docs/runners/
If we host our own running, will that still count toward build minutes? Unfortunately we don't use Bitbucket pipelines for our applications because our testing can take a very long time and we would use up our minutes pretty quickly
Update.. I see a comment mentioning it doesn't count toward it, but wasn't mentioned in the announcement or in the video
Hey Raul!
Thanks for your reply!
We use some pretty big servers to run our runners on, but running a minimum of 50 runners requires some serious memory due to the large memory requirements of the runners theirselves.
Preferably we run multiple tasks on the same runner using multiple threads like the gitlab runner can, otherwise we need a full datacenter with buildboxes.
If running so many runners would be the solution, I'd love to be able to register new runners through an api, otherwise managing runners would become a full time task
Hi,
019bb1602d81 Thanks for the feedback. At the moment, you can run one step per runner at a time. However, you can run multiple runners in the same machine to allow more parallelism. Is this something that would work for you? We will update our docs to mention it.
400097827832 we will support Windows and macOS runners over the next months.
Regards,
Raul
Based on documentation so far, it seems that runners specifically require Linux (Windows being worked upon). What about support for self-hosted runners for macOC (OS X) systems?
We have 5 parallel steps for our pipeline, sometimes running more than 10 pipelines next to each other as our devs are pushing many changes.
As a single runner can run only one step at the time, this would result in us having to run at least 50 runners. (Could you please add this to the documentation as well? It would have saved mee a lot of time if we knew this before starting with our own runners)
Are you going to make it possible to run multiple threads like the gitlab runner does? Because the current implementation is not really feasible if we want to use self hosted runners.
Love to set 8 parallel threads like it's possible with gitlab runners!
Hi,
09aa40dd77e3 we do not bill for the minutes used on self hosted runners as specified in the blog post below, that was a bug in the first beta release and has since been fixed. If you had minutes previously consumed please raise a support case for a refund as mentioned in the EAP community https://community.atlassian.com/t5/Bitbucket-Pipelines-Runners/Plan-build-minutes-getting-consumed-on-local-runner-builds/ba-p/1683135
b617b7d8f896 not currently. These questions and more are also answered on the release blog https://bitbucket.org/blog/pipelines-runners
3f70f45e1dc9 we are happy to chat with you. Please send an email to pipelines-feedback@atlassian.com and we will set some time up.
Kind Regards,
Nathan Burrell
At the risk of (at least partly) duplicating the previous question: do self-hosted runners come with a specific pricing?
Thanks
Hello,
Last time I checked, on-prem pipeline runs were included in the billed minutes for Bitbucket Pipelines. Is that still the case? Is there any plan to change this? Especially with the recently added 8x size, it would be unfair from Bitbucket to bill 8 times the minutes of pipeline runs for a job that is not even running on their servers.
Thanks
Hi product team,
i am working currently on an proof of concept for a company in Germany. We are testing Jira Software Cloud and Bitbucket Cloud and we will test the windows runner for our delphi development team, too. If you need tester/feedback let me know.
Have a great day,
Florian
Hi all,
We are excited to announce Runners General Availability (GA) which contains support for larger step sizes, custom docker images and skip SSL when cloning. Please, try it out and share with us any feedback. For more details, check out our public documentation.
We will work on adding support for Windows and macOS to Runners over the next months. If you need any of the features, please vote and comment in the feature requests, we will be posting more updates over there.
Happy coding!
Raul
Hi!
Any updates on when the roadmap feature Remove limits on runners: July 2021 will be available?
Cheers,
/Mikael
Hi all,
I'd like to share a status update on Bitbucket Pipelines Runners (Beta):
We have released support for multiple runners on the same host.
In order to benefit from this feature, you will need to use v1.167 or greater. You can update to the latest version of the runner by stopping and starting it again, which will pull the latest available version.
With this, you will be able to run multiple runner instances on a single host machine. If you would like to use runners that were created before, please be sure that a runner container name is unique for every runner.
Thanks,
Nadia
Hi michal82,
I just tested this and it appears to be working fine.
Can you please confirm what runner version you are using?
The latest is 1.155, If your using an older runner please update and try again.
If the error still persists can you please raise a support case so we can investigate this at https://support.atlassian.com/bitbucket-cloud/
Thanks,
Nathan
"Please allow us to push docker images to local registries (even if they're insecure) when using the runner."
Curious what is blocking you (haven't tried on-prem agents myself yet).
Please allow us to push docker images to local registries (even if they're insecure) when using the runner.
Hi, first of all thank you for working on this feature. It's going to be super useful for my team.
Just tried to run a pipeline using self hosted runner and all is fine except pushing back to repo. The failing step script is {{}}
git push --tags
{{}}and it works fine when running in cloud.
Here's the error message:
fatal: unable to access 'http://bitbucket.org/{workspace name}/{repo name}/': The requested URL returned error: 502
Hi all,
I'd like to share a status update on Bitbucket Pipelines Runners (Beta):
We're happy to announce that we have released workspace level runners configuration as part of the self-hosted runners open beta release. Please, try it out and let us know any feedback. For more details, check out our public documentation.
We also started looking into adding support for higher memory & CPU, multiple runners per machine, configurable docker daemon and other improvements that will provide more flexibility and control.
Thanks,
Raul
We are excited to announce the open beta program for self-hosted runners. Bitbucket Pipelines Runners is available to everyone. Please try it and let us know your feedback.
Thanks,
Justin
Hey @jthomas any updates on this? Signed up for the EAP but got no response. Org I'm working with is on the point of ditching Bitbucket because of the lack of this functionality. Even open beta would help
We’re excited to introduce an early access program for the Bitbucket Pipelines Runners. We are building self-hosted runners so that you can execute your pipeline or step in your own infrastructure.
Please click here to register and we will be in touch! Further details can be found here.
Thanks,
Justin
Another usecase that I don't see mentioned is when you need to use a non-linux environment, like windows for example.
We're looking at adding the capability to access resources in your private network from Pipelines.
If you're interested in accessing resources in your private network, we need to get some details about your requirements. Here's a Google Form with a few quick questions:
https://forms.gle/qtCuKex6CHaCoUGQ7
Please include anything you think is relevant to us building this feature.
Thanks,
Justin
Closing in on two years and on prem agents are now the norm in competing systems.
hi - Is this something Atlassian can prioritize? if not, do you have other solutions. I am reconsidering moving to gitlab because the runner like functionality is really one of the most important part of setting up automated devops cycle especially for service that needs to access local resource.
I've been working with Microsoft's Azure DevOps platform for a few months now and I must say their on-prem pipeline agent solution is pretty solid. Same YAML-style pipeline building with nicely split up "stages", "jobs", "steps" and variables. Plus you can host several agents on one computer and they will run in parallel. Your resources are the limit. Their cron schedules are a bit clumsy just now but the platform is evolving faster than I expected.
We have tests that need to connect with third party API (don't tell us to mock that, we already done that but there still some tests that need to connect with the real API). Pipelines as in it's current state is not usable for us as the access to the API must only through our local network. We're currently deciding whether to move to gitlab or other services that provide local agent.
... after GitLab and Azure DevOps now GitHub also provides self-hosted runners: https://github.blog/2019-11-05-self-hosted-runners-for-github-actions-is-now-in-beta/ – I really think, Bitbucket urgently needs to provide that, too.
+1. Using bitbucket at work is out of the question with no local agents. I know I'm not the only one with a company that is scared to leap into using the cloud for everything (much to my digress) – local builds are a requirement for anything legal, HR, etc related.
Agree with this too we have some on prem registries that we need to use for builds that we do not want to expose to the world/cloud or waste our site-to-site on.
This is absolutely necessary because having on-prem agent is better than cloud-agents access on-prem servers.
Agree wholeheartedly on this.
Having access to the agent would mean engineers could more rapidly prototype and debug pipelines without needing to push their code to Bitbucket to be run first. For me, I will still use Bitbucket pipelines, but need to as closely as possible fully emulate and debug pipelines so that what I get locally is what I get when I push my code to bitbucket.
At present, there is a layer of abstraction between me and the behaviours I see in Bitbucket, one which stands in the way of me rapidly prototyping pipelines. Remove that barrier, I’d say, by providing developers a means of using the agent in conjunction with containers I choose to work locally and thus remove all issues which are ‘lost in translation’ when arriving at bitbucket.
I am happy to provide a number of examples where this has bitten us in the past,.
If there is a MacOS based agent, that I can host on a dedicated Mac Mini somewhere, then I can also automate xcode based compilations, signing, publishing.
Yes, I agree with folks. It would be perfect to deploy in servers securely without storing any environment-specific secrets in Bitbucket.org
@aneita I can imagine a lot of developers/companies are currently opting for circleCI for their iOS and Mac projects over pipelines. This would reduce the current workarounds you need to build these applications on pipelines, making Bitbucket pipelines a good choice for Mobile and other Mac applications. If you are looking for a way to increase your market share
I would love to see this as well; we would have to use the runner provided by Azure DevOps Pipelines and/or GitLab CI/CD to deploy apps onto servers behind Firewalls soon we move everything to Jira + Bitbucket (currently using Azure DevOps only; not having a runner would be a showstopper for us to use Jira + Bitbucket instead of Azure DevOps).
I would love to see this as well; The current setup works for the majority of our needs but we are hitting blockers on some clients where they house their systems internally and we need to connect via VPN. Which is leading us to look at other options such as Azure DevOps/Gitlab like others have stated above.
What I see as the strength of Bitbucket Pipelines vs Bamboo is the fact that configuration of pipeline jobs is much easier for "anyone" to do in Bitbucket Pipelines, instead of Bamboo. Bamboo also, in my opinion, clutters the elsewise neat setup we have with Jira Cloud, Confluence cloud, and Bitbucket Cloud, in that it is one extra thing that we have to manage, and users arent synced before we also include Crowd into the mix (if I understand the whole ecosystem correctly).
We are a small firm, but there are certain things we would like to only run locally. This can be because it is data intensive analysis (and we would like a predictable CI bill every month, not one that varies wildly according to use), that we are very cautious of where we transfer customer data (transfer securely as infrequently as possible, run on dedicated servers), that we would like to store results in locally accessible VMs, or similar. Some of these can be solved in one manner or the other, surely, but a local runner fixes alot of them in one fell swoop.
So we are in this weird spot where we would like the benefits of Bamboo and Bitbucket Pipelines (local running, but configure in the cloud), but it doesn't seem possible at this time. Yes, you can configure webhooks for bamboo in BitBucket, then configure your infrastructure to pass those hooks to the Bamboo server and run jobs, but it requires a lot more effort than the setup that GitLabs have with their GO-agent setup.
Since administration have great experience with Confluence and Jira from before, we opted to go all-in with Atlassian (we were planning to move our codebases anyway). Gitlab was before that the considered alternative, due to the seemingly effortless setup of CI/CD pipelines, but when demands came in for a better project management tool as well, it fell short.
It is nice with the $10 entrypoint for testing of Bamboo, but it seems like it doesn't work out for our use, and will at least have to find another CI solution, and perhaps another code repository as well.
Just wondering if Atlassian is looking to implement this in the near future at all?
We have had to migrate some repos to Gitlab solely due to the private runner capability - that it allows you to integrate into private/onprem networks.
Both Gitlab and Azure Devops support this feature, and more and more of our customers require this now. It would be a shame for us to have to move away from Bitbucket completely simply due to this missing feature.
Thanks for elaborating!
I'll open this issue to gauge the interest of other users on seeing this functionality in Pipelines. However, given our current priorities, this is unlikely to be something that we work on anytime soon.
Picture a multi-tiered network which only allows very specific traffic in to certain front end services from the web. Picture a pipeline that needs to configure a backend service. If there were an agent that could be installed internally with local access to that service, that communicated out for jobs, then this would be trivial. As it is, we have to use Jenkins or Gitlab or similar that can be installed on-prem and/or in private subnets, because access from the cloud and therefore Bitbucket isn't possible or allowed.
Hi @gerardlynch-vmdb,
Thanks for reaching out and for the suggestion. I'd love to understand in more detail why this is something that you're interested in. Can you elaborate on your use case for using a standalone Pipelines agent?
Aneita
slot wallet เว็บแจกเครดิตฟรี 200 แค่สมัคร ไม่ต้องลงทุนเยอะ สมัครฟรีกับเว็บอันดับ 1 ของไทย