OSDe2e gcp Weather Report 2021-05-16 12:00:32.156825541 +0000 UTC

Share on:

Summary

Job Name Pass Rate More detail
osde2e-prod-gcp-e2e-default 70.21% More Detail
osde2e-prod-gcp-e2e-next 98.12% More Detail
osde2e-prod-gcp-e2e-upgrade-to-latest-z 98.75% More Detail
osde2e-prod-gcp-e2e-upgrade-to-next-y 99.06% More Detail
osde2e-stage-gcp-e2e-next-y 97.47% More Detail
osde2e-stage-gcp-e2e-next-z 98.33% More Detail
osde2e-stage-gcp-e2e-upgrade-to-latest-z 100.00% More Detail

osde2e-prod-gcp-e2e-default

Overall pass rate: 70.21%

Job ID Install Version Upgrade Version Pass Rate Failures
1393597217742262272 4.7.9 88.75%
  • [install] [Suite: e2e] Cluster state should have no alerts
  • [install] [Suite: e2e] Cluster state should include Prometheus data
  • [install] [Suite: e2e] Pods should be Running or Succeeded
  • [install] [Suite: e2e] Pods should not be Failed
  • [install] [Suite: e2e] Storage storage create PVCs
  • [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster
  • [install] [Suite: e2e] Workload (redmine) should get created in the cluster
  • [install] [Suite: e2e] [OSD] OCM Quay Fallback uses a quay mirror when quay is unavailable
  • [install] [Suite: e2e] [OSD] RBAC Dedicated Admins SCC permissions Dedicated Admin permissions can create pods with SCCs
  • [install] [Suite: operators] CloudIngressOperator publishingstrategies cluster admin should be allowed to manage publishingstrategies CR
  • [install] [Suite: operators] CloudIngressOperator publishingstrategies dedicated admin should not be allowed to manage publishingstrategies CR
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion openshift-monitoring/configure-alertmanager-operator should be present and in succeeded state
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready
  • [install] [Suite: operators] [OSD] Custom Domains Operator Should allow dedicated-admins to create domains Should be resolvable by external services
  • [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully
  • [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully
1393718066944151552 4.7.9 24.38%
  • [install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster
  • [install] [Suite: e2e] Cluster state should have no alerts
  • [install] [Suite: e2e] Cluster state should include Prometheus data
  • [install] [Suite: e2e] ImageStreams should exist in the cluster
  • [install] [Suite: e2e] MachineHealthChecks infra MHC should exist
  • [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes
  • [install] [Suite: e2e] MachineHealthChecks worker MHC should exist
  • [install] [Suite: e2e] Pods should be Running or Succeeded
  • [install] [Suite: e2e] Pods should not be Failed
  • [install] [Suite: e2e] Routes should be created for Console
  • [install] [Suite: e2e] Routes should be created for oauth
  • [install] [Suite: e2e] Routes should be functioning for Console
  • [install] [Suite: e2e] Routes should be functioning for oauth
  • [install] [Suite: e2e] Storage sc-list should be able to be expanded
  • [install] [Suite: e2e] Storage storage create PVCs
  • [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster
  • [install] [Suite: e2e] Workload (guestbook) should get created in the cluster
  • [install] [Suite: e2e] Workload (redmine) should get created in the cluster
  • [install] [Suite: e2e] [OSD] HTTP Strict Transport Security Validating HTTP strict transport security should be set for openshift-console OSD managed routes
  • [install] [Suite: e2e] [OSD] HTTP Strict Transport Security Validating HTTP strict transport security should be set for openshift-monitoring OSD managed routes
  • [install] [Suite: e2e] [OSD] OCM Quay Fallback uses a quay mirror when quay is unavailable
  • [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster
  • [install] [Suite: e2e] [OSD] RBAC Dedicated Admins SCC permissions Dedicated Admin permissions can create pods with SCCs
  • [install] [Suite: e2e] [OSD] RBAC Dedicated Admins SCC permissions Dedicated Admin permissions should include anyuid
  • [install] [Suite: e2e] [OSD] RBAC Dedicated Admins SCC permissions Dedicated Admin permissions should include nonroot
  • [install] [Suite: e2e] [OSD] RBAC Dedicated Admins SCC permissions scc-test new SCC does not break pods
  • [install] [Suite: e2e] [OSD] Samesite Cookie Strict Validating samesite cookie should be set for openshift-console OSD managed routes
  • [install] [Suite: e2e] [OSD] Samesite Cookie Strict Validating samesite cookie should be set for openshift-monitoring OSD managed routes
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook dedicated admins can manage customer user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook dedicated admins cannot manage redhat user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook oauth service account can manage customer user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook oauth service account can manage redhat user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook osd-sre-admins cannot manage customer user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook osd-sre-admins cannot manage redhat user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook osd-sre-cluster-admins can manage customer user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook osd-sre-cluster-admins can manage redhat user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook random authenticated user cannot manage customer user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook random authenticated user cannot manage redhat user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook system:admin can manage customer user identity
  • [install] [Suite: e2e] [OSD] identity validating webhook identity validating webhook system:admin can manage redhat user identity
  • [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces
  • [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces
  • [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces
  • [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces
  • [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces
  • [install] [Suite: operators] AlertmanagerInhibitions inhibits ClusterOperatorDegraded
  • [install] [Suite: operators] AlertmanagerInhibitions should exist
  • [install] [Suite: operators] CloudIngressOperator apischeme apischemes CR instance must be present on cluster
  • [install] [Suite: operators] CloudIngressOperator apischeme cluster admin should be allowed to manage apischemes CR
  • [install] [Suite: operators] CloudIngressOperator apischeme dedicated admin should not be allowed to manage apischemes CR
  • [install] [Suite: operators] CloudIngressOperator deployment should exist
  • [install] [Suite: operators] CloudIngressOperator deployment should have all desired replicas ready
  • [install] [Suite: operators] CloudIngressOperator publishingstrategies cluster admin should be allowed to manage publishingstrategies CR
  • [install] [Suite: operators] CloudIngressOperator publishingstrategies dedicated admin should not be allowed to manage publishingstrategies CR
  • [install] [Suite: operators] CloudIngressOperator rh-api-test cidr block changes should updated the service
  • [install] [Suite: operators] CloudIngressOperator rh-api-test hostname should resolve
  • [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace
  • [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoles should exist
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion openshift-monitoring/configure-alertmanager-operator should be present and in succeeded state
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator roles with prefix should exist
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator serviceAccounts should exist
  • [install] [Suite: operators] [OSD] Custom Domains Operator Should allow dedicated-admins to create domains Should be resolvable by external services
  • [install] [Suite: operators] [OSD] Must Gather Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] Must Gather Operator as Members of SRE can manage MustGather CRs in openshift-must-gather-operator namespace
  • [install] [Suite: operators] [OSD] Must Gather Operator as Members of osd-devaccess can manage MustGather CRs in openshift-must-gather-operator namespace
  • [install] [Suite: operators] [OSD] Must Gather Operator clusterRoles should exist
  • [install] [Suite: operators] [OSD] Must Gather Operator clusterServiceVersion openshift-must-gather-operator/must-gather-operator should be present and in succeeded state
  • [install] [Suite: operators] [OSD] Must Gather Operator configmaps should exist
  • [install] [Suite: operators] [OSD] Must Gather Operator deployment should exist
  • [install] [Suite: operators] [OSD] Must Gather Operator deployment should have all desired replicas ready
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test clusterRoleBindings should exist
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test clusterRoles should exist
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test clusterServiceVersion openshift-osd-metrics/osd-metrics-exporter should be present and in succeeded state
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test deployment should exist
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test deployment should have all desired replicas ready
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test service should exist
  • [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully
  • [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully
  • [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg
  • [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist
  • [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion openshift-rbac-permissions/rbac-permissions-operator should be present and in succeeded state
  • [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist
  • [install] [Suite: operators] [OSD] RBAC Operator deployment should exist
  • [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready
  • [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created
  • [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created
  • [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created
  • [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added
  • [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created
  • [install] [Suite: service-definition] [OSD] regularuser validating webhook regularuser validating webhook Privledged users allowed to create autoscalers and delete clusterversion objects
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer users with other IdP and customer group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer users with other IdP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users with SRE IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users with SRE IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users with other IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users with other IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated-admins cannot delete protected redhat users with SRE IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated-admins cannot delete protected redhat users with other IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook osd-sre-cluster-admins can delete protected redhat users with SRE IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook osd-sre-cluster-admins can delete protected redhat users with other IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook osd-sre-cluster-admins can manage customer users with other IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook osd-sre-cluster-admins can manage non-protected redhat users with other IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook osd-sre-cluster-admins can manage protected redhat users with SRE IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook osd-sre-cluster-admins cannot create/update protected redhat users with SRE IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook osd-sre-cluster-admins cannot create/update protected redhat users with other IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage customer users with SRE IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage customer users with SRE IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage customer users with other IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage customer users with other IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage redhat users with SRE IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage redhat users with SRE IDP and no group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage redhat users with other IDP and RH group
  • [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook system:admin can manage redhat users with other IDP and no group
1393838811376521216 4.7.9 97.50%
  • [install] [Suite: operators] [OSD] Custom Domains Operator Should allow dedicated-admins to create domains Should be resolvable by external services
  • [install] [Suite: operators] [OSD] Must Gather Operator clusterServiceVersion openshift-must-gather-operator/must-gather-operator should be present and in succeeded state
  • [install] [Suite: operators] [OSD] Must Gather Operator configmaps should exist
  • [install] [Suite: operators] [OSD] Must Gather Operator deployment should have all desired replicas ready

osde2e-prod-gcp-e2e-next

Overall pass rate: 98.12%

Job ID Install Version Upgrade Version Pass Rate Failures
1393597218685980672 4.7.9 95.00%
  • [install] [Suite: e2e] Cluster state should have no alerts
  • [install] [Suite: e2e] Pods should be Running or Succeeded
  • [install] [Suite: e2e] Pods should not be Failed
  • [install] [Suite: operators] AlertmanagerInhibitions inhibits ClusterOperatorDegraded
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion openshift-monitoring/configure-alertmanager-operator should be present and in succeeded state
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready
1393718067787206656 4.7.9 99.38%
  • [install] [Suite: operators] AlertmanagerInhibitions inhibits ClusterOperatorDegraded
1393838812232159232 4.7.9 100.00%

osde2e-prod-gcp-e2e-upgrade-to-latest-z

Overall pass rate: 98.75%

Job ID Install Version Upgrade Version Pass Rate Failures
1393476421430546432 4.7.9-candidate 4.7.11 98.75%
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] Custom Domains Operator Should allow dedicated-admins to create domains Should be resolvable by external services
  • [upgrade] [Suite: informing] [OSD] pod validating webhook worker nodes on worker nodes
  • [upgrade] [Suite: operators] [OSD] Custom Domains Operator Should allow dedicated-admins to create domains Should be resolvable by external services

osde2e-prod-gcp-e2e-upgrade-to-next-y

Overall pass rate: 99.06%

Job ID Install Version Upgrade Version Pass Rate Failures
1393476422273601536 4.7.9-candidate 4.8.0-fc.3 99.06%
  • [install] [Suite: operators] [OSD] Custom Domains Operator Should allow dedicated-admins to create domains Should be resolvable by external services
  • [upgrade] [Suite: operators] CloudIngressOperator apischeme apischemes CR instance must be present on cluster
  • [upgrade] [Suite: operators] [OSD] Custom Domains Operator Should allow dedicated-admins to create domains Should be resolvable by external services

osde2e-stage-gcp-e2e-next-y

Overall pass rate: 97.47%

Job ID Install Version Upgrade Version Pass Rate Failures
1393597226172813312 4.8.0-fc.3-candidate 97.47%
  • [install] [Suite: e2e] Pods should be Running or Succeeded
  • [install] [Suite: e2e] Pods should not be Failed
  • [install] [Suite: operators] [OSD] Must Gather Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version

osde2e-stage-gcp-e2e-next-z

Overall pass rate: 98.33%

Job ID Install Version Upgrade Version Pass Rate Failures
1393597226973925376 4.7.11-candidate 96.25%
  • [install] [Suite: e2e] Pods should be Running or Succeeded
  • [install] [Suite: e2e] Pods should not be Failed
  • [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] Must Gather Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] OSD Metrics Exporter Basic Test Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version
1393718082031063040 4.7.11-candidate 98.75%
  • [install] [Suite: operators] [OSD] Must Gather Operator Operator Upgrade should upgrade from the replaced version
  • [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version
1393838821434462208 4.7.11-candidate 100.00%

osde2e-stage-gcp-e2e-upgrade-to-latest-z

Overall pass rate: 100.00%

Job ID Install Version Upgrade Version Pass Rate Failures
1393476432335736832 4.7.9-candidate 4.7.11 100.00%