Configure your GitLab Dedicated instance
DETAILS: Tier: Ultimate Offering: GitLab Dedicated
The instructions on this page guide you through configuring your GitLab Dedicated instance, including enabling and updating the settings for available functionality.
Any functionality in the GitLab application that is not controlled by the SaaS environment can be configured by using the Admin Area.
Examples of SaaS environment settings include gitlab.rb
configurations and access to shell, Rails console, and PostgreSQL console.
These environment settings cannot be changed by tenants.
GitLab Dedicated Engineers also don't have direct access to tenant environments, except for break glass situations.
NOTE: An instance refers to a GitLab Dedicated deployment, whereas a tenant refers to a customer.
Configuration changes
Configuration change policy
Configuration changes requested with a support ticket are batched up and applied during your environment's weekly four-hour maintenance window.
This policy does not apply to configuration changes made by a GitLab Dedicated instance admin using Switchboard.
To have a change considered for an upcoming weekly maintenance window, all required information must be submitted in full two business days before the start of the window.
A configuration change might not be applied during an upcoming weekly maintenance window, even if it meets the minimum lead time. If GitLab needs to perform high-priority maintenance tasks that run beyond the maintenance window, configuration changes will be postponed to the following week.
Changes requested with a support ticket cannot be applied outside of a weekly maintenance window unless it qualifies for emergency support.
Configuration changes in Switchboard
Switchboard empowers the user to make limited configuration changes to their GitLab Dedicated instance. As Switchboard matures further configuration changes will be made available.
To change or update the configuration of your GitLab Dedicated instance, use Switchboard following the instructions in the relevant section or open a support ticket with your request.
You can request configuration changes for some of the options originally specified during onboarding, or for any of the following optional features.
Configuration changes made with Switchboard can be applied immediately or deferred until your next scheduled weekly maintenance window.
When applied immediately, changes may take up to 90 minutes to be deployed to your environment. Individual changes are applied in the order they are saved, or you may choose to save several changes at once before applying them in one batch. After your change is deployed, you will receive an email notification. You might have to check your spam folder if it does not show up in your main email folder.
All users with access to view or edit your tenant in Switchboard will receive a notification for each change made. See how to manage Switchboard notification preferences.
NOTE: You will only receive email notifications for changes made by a Switchboard tenant admin. Changes made by a GitLab Operator (e.g. a GitLab version update completed during a maintenance window) will not result in an email notification.
View the configuration change log
You can use the configuration change log to track the changes made to your GitLab Dedicated instance, including:
- Configuration change: Name of the configuration setting that changed.
-
User: Email address of the user that made the configuration change. For changes made by a GitLab Operator, this value will appear as
GitLab Operator
. -
IP: IP address of the user that made the configuration change. For changes made by a GitLab Operator, this value will appear as
Unavailable
. - Status: Whether the configuration change is initiated, in progress, completed, or deferred.
- Start time: Start date and time when the configuration change is initiated, in UTC.
- End time: End date and time when the configuration change is deployed, in UTC.
Each configuration change has a status:
- Initiated: Configuration change is made in Switchboard, but not yet deployed to the instance.
- In progress: Configuration change is currently being deployed to the instance.
- Complete: Configuration change has been deployed to the instance.
- Delayed Initial job to deploy a change has failed and the change has not yet been assigned to a new job.
To view the configuration change log:
- Sign in to Switchboard.
- Select your tenant.
- At the top of the page, select Configuration change log.
Inbound Private Link
AWS Private Link allows users and applications in your VPC on AWS to securely connect to the GitLab Dedicated endpoint without network traffic going over the public internet.
To enable the Inbound Private Link:
-
Open a support ticket. In the body of your support ticket, include the IAM principal for the AWS user or role in your AWS organization that's establishing the VPC endpoint in your AWS account. The IAM principal must be an IAM role principal or IAM user principal. GitLab Dedicated uses this IAM Principal for access-control. This IAM principal is the only one able to set up an endpoint to the service.
-
After your IAM Principal has been allowlisted, GitLab creates the Endpoint Service and communicates the
Service Endpoint Name
on the support ticket. The service name is generated by AWS upon creation of the service endpoint.- GitLab handles the domain verification for the Private DNS name, so that DNS resolution of the tenant instance domain name in your VPC resolves to the PrivateLink endpoint.
- GitLab makes the Endpoint Service available in the Availability Zones you specified during the initial onboarding. If you did not specify any Availability Zones, GitLab randomly selects the Availability Zones IDs.
-
In your own AWS account, create an Endpoint Interface in your VPC, with the following settings:
- Service Endpoint Name: use the name provided by GitLab on the support ticket.
- Private DNS names enabled: yes.
- Subnets: choose all matching subnets.
-
After you create the endpoint, use the instance URL provided to you during onboarding to securely connect to your GitLab Dedicated instance from your VPC, without the traffic going over the public internet.
Outbound Private Link
NOTE: If you plan to add a PrivateLink connection (either inbound or outbound) to your environment, and you require the connections to be available in specific Availability Zones, you must provide up to two Availability Zone IDs to your account team during onboarding. If not specified, GitLab selects two random Availability Zone IDs where the connections are available.
Consider the following when using Outbound Private Links:
- Outbound Private Links allow the GitLab Dedicated instance to securely communicate with services running in your VPC on AWS. This type of connection can execute webhooks where the targeted services are running in your VPC, import or mirror projects and repositories, or use any other GitLab functionality to access private services.
- You can only establish Private Links between VPCs in the same region. Therefore, you can only establish a connection in the regions you selected for your Dedicated instance.
- The Network Load Balancer (NLB) that backs the Endpoint Service at your end must be enabled in at least one of the Availability Zones to which your Dedicated instance was
deployed. This is not the user-facing name such as
us-east-1a
, but the underlying Availability Zone ID. If you did not specify these during onboarding to Dedicated, you must either:- Ask for the Availability Zone IDs in the ticket you raise to enable the link and ensure the NLB is enabled in those AZs, or
- Ensure the NLB has is enabled in every Availability Zone in the region.
You can view the Reverse Private Link IAM Principal
attribute in the Tenant Details section of Switchboard.
To enable an Outbound Private Link:
-
Create the Endpoint service through which your internal service
will be available to GitLab Dedicated. Provide the associated
Service Endpoint Name
on a new support ticket. - In your support ticket, GitLab will provide you with the ARN of an
IAM role that will be initiating the connection to your endpoint service. You must ensure this ARN is included, or otherwise covered by other
entries, in the list of "Allowed Principals" on the Endpoint Service, as described by the AWS documentation.
Though it's optional, you should you add it explicitly, allowing you to set
Acceptance required
to No so that Dedicated can connect in a single operation. If you leaveAcceptance required
as Yes, then you must manually accept the connection after Dedicated has initiated it. - To connect to services using the Endpoint, the Dedicated services require a DNS name. Private Link automatically creates an internal name, but
it is machine-generated and not generally directly useful. There are two options available:
- In your Endpoint Service, enable Private DNS name, perform the
required validation, and let GitLab know in the support ticket that you are using this option. If
Acceptance Required
is set to Yes on your Endpoint Service, also note this on the support ticket because Dedicated will need to initiate the connection without Private DNS, wait for you to confirm it has been accepted, and then update the connection to enable the use of Private DNS. - Dedicated can manage a Private Hosted Zone (PHZ) within the Dedicated AWS Account and alias any arbitrary DNS names to the Endpoint, directing requests for those names to your Endpoint Service. This may be useful if you have multiple DNS names/aliases that will be accessed using a single Endpoint (for example, if you are running a reverse proxy to connect to more than one service in your environment), or if the domain you want to use is not public and cannot be validated for use by Private DNS. Let GitLab know on the support ticket if you are using this option and provide a list of DNS names that should resolve to the Private Link Endpoint. This list can be updated as needed in future.
- In your Endpoint Service, enable Private DNS name, perform the
required validation, and let GitLab know in the support ticket that you are using this option. If
GitLab then configures the tenant instance to create the necessary Endpoint Interfaces based on the service names you provided. Any matching outbound connections made from the tenant instance are directed through the PrivateLink into your VPC.
Custom certificates
In some cases, the GitLab Dedicated instance can't reach an internal service you own because it exposes a certificate that can't be validated using a public Certification Authority (CA). In these cases, custom certificates are required.
Add a custom certificate with Switchboard
- Sign in to Switchboard.
- At the top of the page, select Configuration.
- Expand Custom Certificate Authorities.
- Select + Add Certificate.
- Paste the certificate into the text box.
- Select Save.
- Scroll up to the top of the page and select whether to apply the changes immediately or during the next maintenance window.
Add a custom certificate with a Support Request
To request that GitLab add custom certificates when communicating with your services over PrivateLink, attach the custom public certificate files to your support ticket.
Maximum number of reverse PrivateLink connections
GitLab Dedicated limits the number of reverse PrivateLink connections to 10.
IP allowlist
GitLab Dedicated allows you to control which IP addresses can access your instance through an IP allowlist. Once the IP allowlist has been enabled, when an IP not on the allowlist tries to access your instance an HTTP 403 Forbidden
response is returned.
IP addresses that have been added to your IP allowlist can be viewed on the Configuration page in Switchboard. You can add or remove IP addresses from your allowlist with Switchboard or a support request.
Add an IP to the allowlist with Switchboard
- Sign in to Switchboard.
- At the top of the page, select Configuration.
- Expand Allowed Source List Config / IP allowlist.
- Turn on the Enable toggle.
- Select Add Item.
- Enter the IP address and description. To add another IP address, repeat steps 5 and 6.
- Select Save.
- Scroll up to the top of the page and select whether to apply the changes immediately or during the next maintenance window. After the changes are applied, the IP addresses are added to the IP allowlist for your instance.
Add an IP to the allowlist with a Support Request
Specify a comma separated list of IP addresses that can access your GitLab Dedicated instance in your support ticket. The IP addresses are then added to the IP allowlist for your instance.
SAML
NOTE: GitLab Dedicated supports a limited number of SAML parameters. Parameters not shown in the configuration below are unavailable for GitLab Dedicated instances.
Prerequisites:
- You must configure the identity provider before sending the required data to GitLab.
Activate SAML with Switchboard
To activate SAML for your GitLab Dedicated instance:
- Sign in to Switchboard.
- At the top of the page, select Configuration.
- Expand SAML Config.
- Turn on the Enable toggle.
- Complete the fields.
- Select Save.
- Scroll up to the top of the page and select whether to apply the changes immediately or during the next maintenance window.
- To verify the SAML configuration is successful:
- Check that the SSO button description is displayed on your instance's sign-in page.
- Go to the metadata URL of your instance (
https://INSTANCE-URL/users/auth/saml/metadata
). This page can be used to simplify much of the configuration of the identity provider, and manually validate the settings.
Activate SAML with a Support Request
To activate SAML for your GitLab Dedicated instance:
-
To make the necessary changes, include the desired SAML configuration block for your GitLab application in your support ticket. At a minimum, GitLab needs the following information to enable SAML for your instance:
- IDP SSO Target URL
- Certificate fingerprint or certificate
- NameID format
- SSO login button description
"saml": { "attribute_statements": { //optional }, "enabled": true, "groups_attribute": "", "admin_groups": [ // optional ], "idp_cert_fingerprint": "43:51:43:a1:b5:fc:8b:b7:0a:3a:a9:b1:0f:66:73:a8", "idp_sso_target_url": "https://login.example.com/idp", "label": "IDP Name", "name_identifier_format": "urn:oasis:names:tc:SAML:2.0:nameid-format:persistent", "security": { // optional }, "auditor_groups": [ // optional ], "external_groups": [ // optional ], "required_groups": [ // optional ], }
-
After GitLab deploys the SAML configuration to your instance, you are notified on your support ticket.
-
To verify the SAML configuration is successful:
- Check that the SSO login button description is displayed on your instance's login page.
- Go to the metadata URL of your instance (
https://INSTANCE-URL/users/auth/saml/metadata
). This page can be used to simplify much of the configuration of the identity provider, as well as manually validate the settings.
Request signing
If SAML request signing is desired, a certificate must be obtained. This certificate can be self-signed which has the advantage of not having to prove ownership of an arbitrary Common Name (CN) to a public Certificate Authority (CA).
If you choose to enable SAML request signing, the manual steps below will need to be completed before you are able to use SAML, since it requires certificate signing to happen.
To enable SAML request signing, indicate on your SAML support ticket that you want request signing enabled. GitLab works with you on sending the Certificate Signing Request (CSR) for you to sign. Alternatively, the CSR can be signed with a public CA. After the certificate is signed, GitLab adds the certificate and its associated private key to the security
section of the SAML configuration. Authentication requests from GitLab to your identity provider can then be signed.
SAML groups
With SAML groups you can configure GitLab users based on SAML group membership.
To enable SAML groups, add the required elements to the SAML configuration block you provide in your support ticket.
Group sync
With group sync, you can sync users across identity provider groups to mapped groups in GitLab.
To enable group sync:
- Add the required elements to the SAML configuration block you provide in your support ticket.
- Configure the Group Links.
Add users to an instance
Administrators can add Switchboard users to their GitLab Dedicated instance. There are two types of users:
- Read only: Users can only view instance data.
- Admin: Users can edit the instance configuration and manage users.
To add a new user to your GitLab Dedicated instance:
- From the Tenants page, select Manage next to the tenant instance.
- From the top of the page, select Users.
- Select New user.
- Enter the Email and select a Role for the user.
- Select Create.
An invitation to use Switchboard is sent to the user.
Manage notification preferences
You can specify whether or not you want to receive email notifications from Switchboard.
To manage your own email notification preferences:
- From any page, open the dropdown next to your user name.
- To stop receiving email notifications, select Toggle email notifications off.
- To resume receiving email notifications, select Toggle email notifications on.
You will see an alert confirming that your notification preferences have been updated.
Switchboard Tenant Admins can also manage email notifications for other users with access to their organization's tenant:
- From the Users page, open the dropdown in the Email notifications column next to the user's email.
- To turn off email notifications for that user, select No.
- To turn on email notifications for that user, select Yes.
You will see an alert confirming that your notification preferences have been updated.
Access to application logs
GitLab application logs are delivered to an S3 bucket in the GitLab tenant account, which can be shared with you. Logs stored in the S3 bucket are retained indefinitely, until the 1 year retention policy is fully enforced. GitLab team members can view more information in this confidential issue:
https://gitlab.com/gitlab-com/gl-infra/gitlab-dedicated/team/-/issues/483
.
To gain read only access to this bucket:
- Open a support ticket with the title "Customer Log Access". In the body of the ticket, include a list of IAM Principal ARNs (users or roles) that are fetching the logs from S3.
- GitLab then informs you of the name of the S3 bucket. Your nominated users/roles are then able to list and get all objects in the S3 bucket.
You can use the AWS CLI to verify that access to the S3 bucket works as expected.
Bucket contents and structure
The S3 bucket contains a combination of infrastructure logs and application logs from the GitLab log system. The logs in the bucket are encrypted using an AWS KMS key that is managed by GitLab. If you choose to enable BYOK, the application logs are not encrypted with the key you provide.
The logs in the S3 bucket are organized by date in YYYY/MM/DD/HH
format. For example, there would be a directory like 2023/10/12/13
. That directory would contain the logs from October 12, 2023 at 1300 UTC. The logs are streamed into the bucket with Amazon Kinesis Data Firehose.
Troubleshooting
Outbound Private Link
If you have trouble establishing a connection after the Outbound Private Link has been set up, there are a few things in your AWS infrastructure that could be the cause of the problem. The specific things to check will vary based on the unexpected behavior you're seeking to fix. Things to check include:
- Ensure that cross-zone load balancing is turned on in your Network Load Balancer (NLB).
- Ensure that the Inbound Rules section of the appropriate Security Groups permits traffic from the correct IP ranges.
- Ensure that the inbound traffic is mapped to the correct port on the Endpoint Service.
- In Switchboard, expand Reverse Private Link Config and confirm that the details appear as you expect.
- Ensure that you have allowed requests to the local network from webhooks and integrations.