OSDe2e aws Weather Report 2020-08-11 12:00:27.753889408 +0000 UTC

Aug 11, 2020 weather-report aws

Summary

Job Name	Pass Rate	More detail
osde2e-int-aws-e2e-osd-default-nightly	0.00%	More Detail
osde2e-int-aws-e2e-osd-default-plus-one-nightly	0.00%	More Detail
osde2e-int-aws-e2e-osd-default-plus-two-nightly	0.00%	More Detail
osde2e-int-aws-e2e-upgrade-to-osd-default-nightly	40.87%	More Detail
osde2e-int-aws-e2e-upgrade-to-osd-default-plus-one-nightly	19.37%	More Detail
osde2e-prod-aws-e2e-default	85.71%	More Detail
osde2e-prod-aws-e2e-middle-imageset	100.00%	More Detail
osde2e-prod-aws-e2e-next	85.26%	More Detail
osde2e-prod-aws-e2e-oldest-imageset	100.00%	More Detail
osde2e-prod-aws-e2e-upgrade-prod-minus-four-to-next	100.00%	More Detail
osde2e-prod-aws-e2e-upgrade-prod-minus-one-to-next	100.00%	More Detail
osde2e-prod-aws-e2e-upgrade-prod-minus-three-to-next	100.00%	More Detail
osde2e-prod-aws-e2e-upgrade-prod-minus-two-to-next	99.60%	More Detail
osde2e-stage-aws-e2e-default	98.41%	More Detail
osde2e-stage-aws-e2e-middle-imageset	98.41%	More Detail
osde2e-stage-aws-e2e-next	27.89%	More Detail
osde2e-stage-aws-e2e-oldest-imageset	0.00%	More Detail
osde2e-stage-aws-e2e-upgrade-default-next	56.24%	More Detail
osde2e-stage-aws-e2e-upgrade-default-next-z	46.96%	More Detail

osde2e-int-aws-e2e-osd-default-nightly

Overall pass rate: 0.00%

Job ID	Install Version	Pass Rate	Failures
1292980070247305216	4.4.0-0.nightly-2020-08-10-202559-stable	0.00%	[install] BeforeSuite
1293034578641948672	4.4.0-0.nightly-2020-08-10-202559-stable	0.00%	[install] BeforeSuite
1293094919790923776	4.4.0-0.nightly-2020-08-11-034134-stable	0.00%	[install] BeforeSuite
1292732557518966784	4.4.0-0.nightly-2020-08-05-165415	0.00%	[install] BeforeSuite
1292792962698186752	4.4.0-0.nightly-2020-08-05-165415	0.00%	[install] BeforeSuite
1292853364358385664	4.4.0-0.nightly-2020-08-10-101821-stable	0.00%	[install] BeforeSuite
1292913767041994752	4.4.0-0.nightly-2020-08-10-125530-stable	0.00%	[install] BeforeSuite

osde2e-int-aws-e2e-osd-default-plus-one-nightly

Overall pass rate: 0.00%

Job ID	Install Version	Pass Rate	Failures
1292792964375908352	4.5.0-0.nightly-2020-08-05-164433	0.00%	[install] BeforeSuite
1292853365717340160	4.5.0-0.nightly-2020-08-10-061547-stable	0.00%	[install] BeforeSuite
1292913767142658048	4.5.0-0.nightly-2020-08-10-150345-stable	0.00%	[install] BeforeSuite
1292979567757103104	4.5.0-0.nightly-2020-08-10-150345-stable	0.00%	[install] BeforeSuite
1293034578717446144	4.5.0-0.nightly-2020-08-10-150345-stable	0.00%	[install] BeforeSuite
1293094919891587072	4.5.0-0.nightly-2020-08-10-150345-stable	0.00%	[install] BeforeSuite
1292732558122946560	4.5.0-0.nightly-2020-08-05-164433	0.00%	[install] BeforeSuite

osde2e-int-aws-e2e-osd-default-plus-two-nightly

Overall pass rate: 0.00%

Job ID	Install Version	Pass Rate	Failures
1292980135716196352	4.6.0-0.nightly-2020-08-10-200500-stable	0.00%	[install] BeforeSuite
1293034578977492992	4.6.0-0.nightly-2020-08-10-233406-stable	0.00%	[install] BeforeSuite
1293094921288290304	4.6.0-0.nightly-2020-08-11-040013-stable	0.00%	[install] BeforeSuite
1292732559775502336	4.6.0-0.nightly-2020-08-05-174122	0.00%	[install] BeforeSuite
1292792966741495808	4.6.0-0.nightly-2020-08-05-174122	0.00%	[install] BeforeSuite
1292853367374090240	4.6.0-0.nightly-2020-08-10-120608-stable	0.00%	[install] BeforeSuite
1292913767234932736	4.6.0-0.nightly-2020-08-10-150008-stable	0.00%	[install] BeforeSuite

osde2e-int-aws-e2e-upgrade-to-osd-default-nightly

Overall pass rate: 40.87%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292732557544132608	4.4.11	4.4.0-0.nightly-2020-08-10-015804	0.00%	[install] BeforeSuite
1292792963537047552	4.4.11	4.4.0-0.nightly-2020-08-10-015804	0.00%	[install] BeforeSuite
1292853364874285056	4.4.11	4.4.0-0.nightly-2020-08-10-101821	49.21%	[install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1292913767125880832	4.4.11	4.4.0-0.nightly-2020-08-10-125530	98.41%	[upgrade] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [upgrade] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version
1292979833667588096	4.4.11	4.4.0-0.nightly-2020-08-10-202559	49.21%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1293034578679697408	4.4.11	4.4.0-0.nightly-2020-08-10-202559	48.41%	[Log Metrics] cluster-mgmt-500 [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [Log Metrics] cluster-mgmt-500 [upgrade] BeforeSuite

osde2e-int-aws-e2e-upgrade-to-osd-default-plus-one-nightly

Overall pass rate: 19.37%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292979778772537344	4.4.11	4.5.0-0.nightly-2020-08-10-150345	48.41%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1293034578771972096	4.4.11	4.5.0-0.nightly-2020-08-10-150345	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1292732558936641536	4.4.11	4.5.0-0.nightly-2020-08-08-162221	0.00%	[install] BeforeSuite
1292792965223157760	4.4.11	4.5.0-0.nightly-2020-08-10-061547	0.00%	[install] BeforeSuite
1292913767180406784	4.4.11	4.5.0-0.nightly-2020-08-10-150345	48.41%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite

osde2e-prod-aws-e2e-default

Overall pass rate: 85.71%

Job ID	Install Version	Pass Rate	Failures
1292732561453223936	4.4.11	100.00%
1292792967580356608	4.4.11	100.00%
1292853368221339648	4.4.11	100.00%
1292913767285264384	4.4.11	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1292979791720353792	4.4.11	100.00%
1293034579078156288	4.4.11	100.00%
1293094922735325184	4.4.11	100.00%

osde2e-prod-aws-e2e-middle-imageset

Overall pass rate: 100.00%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292430574060834816	4.3.19		100.00%
1292792969258078208	4.3.19		100.00%

osde2e-prod-aws-e2e-next

Overall pass rate: 85.26%

Job ID	Install Version	Pass Rate	Failures
1292979502254657536	4.4.11	100.00%
1293034579392729088	4.4.11	98.41%	[install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version
1293094924522098688	4.4.11	100.00%
1292732563130945536	4.4.11	100.00%
1292792970096939008	4.4.11	98.41%	[install] [Suite: e2e] Cluster state should have no alerts
1292853369890672640	4.4.11	100.00%
1292913769415970816	4.4.11	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users

osde2e-prod-aws-e2e-oldest-imageset

Overall pass rate: 100.00%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292430575667253248	4.3.0		100.00%
1292792970935799808	4.3.0		100.00%

osde2e-prod-aws-e2e-upgrade-prod-minus-four-to-next

Overall pass rate: 100.00%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292823161083006976	4.3.0	4.3.18	100.00%

osde2e-prod-aws-e2e-upgrade-prod-minus-one-to-next

Overall pass rate: 100.00%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1293004449437978624	4.3.25	4.4.11	100.00%

osde2e-prod-aws-e2e-upgrade-prod-minus-three-to-next

Overall pass rate: 100.00%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292762757791223808	4.3.18	4.3.25	100.00%

osde2e-prod-aws-e2e-upgrade-prod-minus-two-to-next

Overall pass rate: 99.60%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1293064722777640960	4.3.19	4.3.25	100.00%
1292702358135902208	4.3.19	4.3.25	99.21%	[upgrade] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version

osde2e-stage-aws-e2e-default

Overall pass rate: 98.41%

Job ID	Install Version	Pass Rate	Failures
1292913770259025920	4.4.11	98.41%	[install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version
1292979543346253824	4.4.11	100.00%
1293034579531141120	4.4.11	98.41%	[install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version
1293094926107545600	4.4.11	96.83%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version
1292732564808667136	4.4.11	98.41%	[install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version
1292792971778854912	4.4.11	100.00%
1292853370725339136	4.4.11	96.83%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version

osde2e-stage-aws-e2e-middle-imageset

Overall pass rate: 98.41%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292430579031085056	4.4.12		98.41%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version
1292792974295437312	4.4.12		98.41%	[install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version

osde2e-stage-aws-e2e-next

Overall pass rate: 27.89%

Job ID	Install Version	Pass Rate	Failures
1293094928791900160	4.6.0-fc.0-fast	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1292732568117972992	4.5.5	96.83%	[install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version
1292792975134298112	4.5.5	98.41%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version
1292853373250310144	4.6.0-fc.0-fast	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1292913772775608320	4.6.0-fc.0-fast	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1292979753971617792	4.6.0-fc.0-fast	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1293034582005780480	4.6.0-fc.0-fast	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users

osde2e-stage-aws-e2e-oldest-imageset

Overall pass rate: 0.00%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292430580708806656	4.1.38		0.00%	[install] BeforeSuite
1292792976820408320	4.1.38		0.00%	[install] BeforeSuite

osde2e-stage-aws-e2e-upgrade-default-next

Overall pass rate: 56.24%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292913771940941824	4.4.11	4.4.16	99.21%	[upgrade] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version
1292979965393899520	4.4.11	4.4.16	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1293034581255000064	4.4.11	4.4.16	99.21%	[Log Metrics] cluster-mgmt-500 [upgrade] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version
1293094928011759616	4.4.11	4.4.16	49.21%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1292732566486388736	4.4.11	4.4.16	48.41%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1292792973452382208	4.4.11	4.4.16	48.41%	[install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1292853372407255040	4.4.11	4.4.16	49.21%	[install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite

osde2e-stage-aws-e2e-upgrade-default-next-z

Overall pass rate: 46.96%

Job ID	Install Version	Upgrade Version	Pass Rate	Failures
1292853371568394240	4.4.11	4.4.16	45.24%	[Log Metrics] host-dns-lookup [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [Log Metrics] host-dns-lookup [upgrade] BeforeSuite
1292913771127246848	4.4.11	4.4.16	0.00%	[install] [Suite: app-builds] OpenShift Application Build E2E should get created in the cluster [install] [Suite: e2e] Cluster state should have no alerts [install] [Suite: e2e] Cluster state should include Prometheus data [install] [Suite: e2e] ImageStreams should exist in the cluster [install] [Suite: e2e] MachineHealthChecks should exist [install] [Suite: e2e] MachineHealthChecks should replace unhealthy nodes [install] [Suite: e2e] Pods should be Running or Succeeded [install] [Suite: e2e] Pods should not be Failed [install] [Suite: e2e] Routes should be created for Console [install] [Suite: e2e] Routes should be created for oauth [install] [Suite: e2e] Routes should be functioning for Console [install] [Suite: e2e] Routes should be functioning for oauth [install] [Suite: e2e] Storage should be able to be expanded [install] [Suite: e2e] Validation Webhook should exist and be running in the cluster [install] [Suite: e2e] Workload (guestbook) should get created in the cluster [install] [Suite: e2e] Workload (redmine) should get created in the cluster [install] [Suite: e2e] [OSD] Prometheus Exporters should exist and be running in the cluster [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Members of SRE groups can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users can manage all non-privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Non-privileged users cannot manage privileged namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook dedicated admins cannot manage privileged namespaces [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret exist under openshift-config namespace [install] [Suite: operators] [OSD] Certman Operator certificate secret should be applied when cluster installed certificate secret should be applied to apiserver object [install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator configmaps should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Configure AlertManager Operator roleBindings should exist [install] [Suite: operators] [OSD] Configure AlertManager Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator configmaps should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should exist [install] [Suite: operators] [OSD] Managed Velero Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Managed Velero Operator roleBindings should exist [install] [Suite: operators] [OSD] Managed Velero Operator roles should exist [install] [Suite: operators] [OSD] Managed Velero Operator velero backups should be complete [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works builds-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works deployments-pruner should run successfully [install] [Suite: operators] [OSD] Prune jobs pruner jobs should works image-pruner should run successfully [install] [Suite: operators] [OSD] RBAC Dedicated Admins SubjectPermission SubjectPermission should have the expected ClusterRoles, ClusterRoleBindings and RoleBindinsg [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [install] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] RBAC Operator configmaps should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should exist [install] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoleBindings should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterRoles should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator clusterServiceVersion should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator configmaps should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should exist [install] [Suite: operators] [OSD] Splunk Forwarder Operator deployment should have all desired replicas ready [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed empty node-label daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed infra node daemonset should get created [install] [Suite: service-definition] [OSD] DaemonSets DaemonSets are not allowed worker node daemonset should get created [install] [Suite: service-definition] [OSD] NodeLabels Modifying nodeLabels is not allowed node-label cannot be added [install] [Suite: service-definition] [OSD] Privileged Containers Privileged containers are not allowed privileged container should not get created [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins can manage customer user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat user identity [install] [Suite: service-definition] [OSD] user validating webhook user validating webhook dedicated admins cannot manage redhat users
1292980177936060416	4.4.11	4.4.16	47.62%	[install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1293094927269367808	4.4.11	4.4.16	93.65%	[upgrade] [Suite: e2e] ImageStreams should exist in the cluster [upgrade] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [upgrade] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [upgrade] [Suite: operators] [OSD] RBAC Operator clusterRoles should exist [upgrade] [Suite: operators] [OSD] RBAC Operator clusterServiceVersion should exist [upgrade] [Suite: operators] [OSD] RBAC Operator configmaps should exist [upgrade] [Suite: operators] [OSD] RBAC Operator deployment should exist [upgrade] [Suite: operators] [OSD] RBAC Operator deployment should have all desired replicas ready
1292732565651722240	4.4.11	4.4.16	47.62%	[install] [Suite: operators] [OSD] Configure AlertManager Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite
1292792972613521408	4.4.11	4.4.16	47.62%	[install] [Suite: e2e] [OSD] namespace validating webhook namespace validating webhook Privileged users can manage all namespaces [install] [Suite: operators] [OSD] RBAC Operator Operator Upgrade should upgrade from the replaced version [install] [Suite: operators] [OSD] Splunk Forwarder Operator Operator Upgrade should upgrade from the replaced version [upgrade] BeforeSuite