Skip to content

[4.8] Latest health test run #1752

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
yadvr wants to merge 1 commit into from
Closed

[4.8] Latest health test run #1752

yadvr wants to merge 1 commit into from

Conversation

@yadvr
Copy link
Member

@yadvr yadvr commented Nov 9, 2016

Dummy PR to trigger tests on 4.8 branch

@yadvr
dummy commit
3cf73c9 
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
@yadvr
Copy link
Member Author

yadvr commented Nov 9, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Nov 9, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@yadvr yadvr mentioned this pull request Nov 9, 2016
Merged
@yadvr
Copy link
Member Author

yadvr commented Nov 9, 2016

@blueorangutan test matrix

@yadvr
Copy link
Member Author

yadvr commented Nov 20, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Nov 20, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-177

@yadvr
Copy link
Member Author

yadvr commented Nov 21, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Nov 21, 2016

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@yadvr
Copy link
Member Author

yadvr commented Nov 22, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Nov 22, 2016

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Nov 22, 2016

Trillian test result (tid-391)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 27091 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t391-kvm-centos7.zip
Test completed. 42 look ok, 1 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 906.80 test_vpc_redundant.py
test_01_vpc_site2site_vpn Success 175.76 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 71.83 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 282.55 test_vpc_vpn.py
test_02_VPC_default_routes Success 280.91 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 548.19 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 522.27 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1377.58 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 586.88 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1403.32 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.60 test_volumes.py
test_08_resize_volume Success 15.46 test_volumes.py
test_07_resize_fail Success 20.44 test_volumes.py
test_06_download_detached_volume Success 15.44 test_volumes.py
test_05_detach_volume Success 100.32 test_volumes.py
test_04_delete_attached_volume Success 10.28 test_volumes.py
test_03_download_attached_volume Success 10.68 test_volumes.py
test_02_attach_volume Success 44.68 test_volumes.py
test_01_create_volume Success 715.12 test_volumes.py
test_deploy_vm_multiple Success 273.81 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.39 test_vm_life_cycle.py
test_09_expunge_vm Success 125.19 test_vm_life_cycle.py
test_08_migrate_vm Success 41.21 test_vm_life_cycle.py
test_07_restore_vm Success 0.22 test_vm_life_cycle.py
test_06_destroy_vm Success 126.12 test_vm_life_cycle.py
test_03_reboot_vm Success 126.12 test_vm_life_cycle.py
test_02_start_vm Success 10.19 test_vm_life_cycle.py
test_01_stop_vm Success 40.33 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 96.00 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.06 test_templates.py
test_05_template_permissions Success 0.09 test_templates.py
test_04_extract_template Success 5.20 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.16 test_templates.py
test_01_create_template Success 65.64 test_templates.py
test_10_destroy_cpvm Success 161.73 test_ssvm.py
test_09_destroy_ssvm Success 168.76 test_ssvm.py
test_08_reboot_cpvm Success 131.60 test_ssvm.py
test_07_reboot_ssvm Success 133.56 test_ssvm.py
test_06_stop_cpvm Success 136.76 test_ssvm.py
test_05_stop_ssvm Success 134.63 test_ssvm.py
test_04_cpvm_internals Success 1.21 test_ssvm.py
test_03_ssvm_internals Success 3.46 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_01_snapshot_root_disk Success 17.29 test_snapshots.py
test_04_change_offering_small Success 210.87 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.07 test_service_offerings.py
test_01_create_service_offering Success 0.15 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_09_reboot_router Success 35.46 test_routers.py
test_08_start_router Success 50.44 test_routers.py
test_07_stop_router Success 10.16 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.77 test_routers.py
test_03_restart_network_cleanup Success 60.71 test_routers.py
test_02_router_internal_adv Success 1.04 test_routers.py
test_01_router_internal_basic Success 0.59 test_routers.py
test_router_dhcphosts Success 277.84 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.20 test_resource_detail.py
test_01_reset_vm_on_reboot Success 161.39 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.56 test_pvlan.py
test_dedicatePublicIpRange Success 0.39 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 611.26 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 594.63 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 438.87 test_privategw_acl.py
test_01_vpc_privategw_acl Success 83.71 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.90 test_primary_storage.py
test_createPortablePublicIPRange Success 15.53 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.54 test_portable_publicip.py
test_isolate_network_password_server Success 89.51 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.15 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.39 test_non_contigiousvlan.py
test_01_nic Success 819.03 test_nic.py
test_releaseIP Success 295.38 test_network.py
test_reboot_router Success 405.02 test_network.py
test_public_ip_user_account Success 10.53 test_network.py
test_public_ip_admin_account Success 40.28 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.17 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.99 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.48 test_network.py
test_delete_account Success 284.08 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.74 test_network.py
test_01_port_fwd_on_src_nat Success 112.38 test_network.py
test_nic_secondaryip_add_remove Success 203.80 test_multipleips_per_nic.py
login_test_saml_user Success 26.27 test_login.py
test_assign_and_removal_lb Success 135.36 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.41 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 200.77 test_loadbalance.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.29 test_iso.py
test_03_delete_iso Success 95.19 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 21.93 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 268.99 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 188.30 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 582.18 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 497.58 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.37 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.21 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.08 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 56.10 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.69 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.76 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.48 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 51.11 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.93 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.89 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 290.47 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 245.40 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 86.45 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.05 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Nov 22, 2016

Trillian test result (tid-390)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 30654 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t390-xenserver-65sp1.zip
Test completed. 41 look ok, 2 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 422.71 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 413.34 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 510.10 test_vpc_redundant.py
ContextSuite context=TestVPCRedundancy>:teardown Error 740.71 test_vpc_redundant.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Error 919.50 test_internal_lb.py
test_01_vpc_site2site_vpn Success 316.92 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 146.99 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 553.29 test_vpc_vpn.py
test_02_VPC_default_routes Success 306.58 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 658.65 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 782.54 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1004.71 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.76 test_volumes.py
test_08_resize_volume Success 91.08 test_volumes.py
test_07_resize_fail Success 96.07 test_volumes.py
test_06_download_detached_volume Success 30.43 test_volumes.py
test_05_detach_volume Success 100.32 test_volumes.py
test_04_delete_attached_volume Success 10.24 test_volumes.py
test_03_download_attached_volume Success 15.36 test_volumes.py
test_02_attach_volume Success 10.68 test_volumes.py
test_01_create_volume Success 393.06 test_volumes.py
test_03_delete_vm_snapshots Success 280.28 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 191.47 test_vm_snapshots.py
test_01_create_vm_snapshots Success 134.07 test_vm_snapshots.py
test_deploy_vm_multiple Success 173.23 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 32.62 test_vm_life_cycle.py
test_09_expunge_vm Success 185.21 test_vm_life_cycle.py
test_08_migrate_vm Success 146.78 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 10.17 test_vm_life_cycle.py
test_03_reboot_vm Success 10.20 test_vm_life_cycle.py
test_02_start_vm Success 15.23 test_vm_life_cycle.py
test_01_stop_vm Success 30.32 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 136.18 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.23 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.17 test_templates.py
test_01_create_template Success 90.87 test_templates.py
test_10_destroy_cpvm Success 202.40 test_ssvm.py
test_09_destroy_ssvm Success 229.18 test_ssvm.py
test_08_reboot_cpvm Success 121.47 test_ssvm.py
test_07_reboot_ssvm Success 143.94 test_ssvm.py
test_06_stop_cpvm Success 141.68 test_ssvm.py
test_05_stop_ssvm Success 138.82 test_ssvm.py
test_04_cpvm_internals Success 1.14 test_ssvm.py
test_03_ssvm_internals Success 3.41 test_ssvm.py
test_02_list_cpvm_vm Success 0.20 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 31.69 test_snapshots.py
test_04_change_offering_small Success 91.23 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.09 test_service_offerings.py
test_01_create_service_offering Success 0.08 test_service_offerings.py
test_02_sys_template_ready Success 0.11 test_secondary_storage.py
test_01_sys_vm_start Success 0.16 test_secondary_storage.py
test_01_scale_vm Success 5.23 test_scale_vm.py
test_09_reboot_router Success 50.44 test_routers.py
test_08_start_router Success 40.42 test_routers.py
test_07_stop_router Success 10.19 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.57 test_routers.py
test_03_restart_network_cleanup Success 126.02 test_routers.py
test_02_router_internal_adv Success 0.81 test_routers.py
test_01_router_internal_basic Success 0.45 test_routers.py
test_router_dhcphosts Success 138.31 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.13 test_resource_detail.py
test_01_reset_vm_on_reboot Success 105.87 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.30 test_pvlan.py
test_dedicatePublicIpRange Success 0.57 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 962.09 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 930.77 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 682.35 test_privategw_acl.py
test_01_vpc_privategw_acl Success 154.25 test_privategw_acl.py
test_01_primary_storage_nfs Success 39.05 test_primary_storage.py
test_01_primary_storage_iscsi Success 78.74 test_primary_storage.py
test_createPortablePublicIPRange Success 15.24 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.52 test_portable_publicip.py
test_isolate_network_password_server Success 61.07 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.26 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.44 test_non_contigiousvlan.py
test_01_nic Success 949.29 test_nic.py
test_releaseIP Success 299.45 test_network.py
test_reboot_router Success 520.52 test_network.py
test_public_ip_user_account Success 10.32 test_network.py
test_public_ip_admin_account Success 40.63 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.54 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.56 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 91.88 test_network.py
test_delete_account Success 238.83 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.79 test_network.py
test_01_port_fwd_on_src_nat Success 78.91 test_network.py
test_nic_secondaryip_add_remove Success 219.40 test_multipleips_per_nic.py
login_test_saml_user Success 25.21 test_login.py
test_assign_and_removal_lb Success 143.98 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.43 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 203.87 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.08 test_iso.py
test_04_extract_Iso Success 5.24 test_iso.py
test_03_delete_iso Success 95.21 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.96 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 480.75 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 309.40 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 688.58 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.36 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.22 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.08 test_disk_offerings.py
test_03_delete_disk_offering Success 0.06 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 41.59 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 151.71 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 222.29 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 20.57 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 136.51 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.86 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.78 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.94 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 148.41 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 156.76 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Nov 22, 2016

Trillian test result (tid-392)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34314 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t392-vmware-55u3.zip
Test completed. 42 look ok, 1 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Error 447.80 test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
test_02_VPC_default_routes Success 375.24 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 677.79 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 502.52 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1532.46 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 623.17 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 522.49 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1140.00 test_vpc_redundant.py
test_09_delete_detached_volume Success 26.13 test_volumes.py
test_06_download_detached_volume Success 71.11 test_volumes.py
test_05_detach_volume Success 110.38 test_volumes.py
test_04_delete_attached_volume Success 10.54 test_volumes.py
test_03_download_attached_volume Success 15.47 test_volumes.py
test_02_attach_volume Success 58.96 test_volumes.py
test_01_create_volume Success 452.97 test_volumes.py
test_03_delete_vm_snapshots Success 280.26 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 194.52 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 202.15 test_vm_snapshots.py
test_01_create_vm_snapshots Success 129.39 test_vm_snapshots.py
test_deploy_vm_multiple Success 209.20 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.28 test_vm_life_cycle.py
test_09_expunge_vm Success 125.30 test_vm_life_cycle.py
test_08_migrate_vm Success 66.65 test_vm_life_cycle.py
test_07_restore_vm Success 0.15 test_vm_life_cycle.py
test_06_destroy_vm Success 10.17 test_vm_life_cycle.py
test_03_reboot_vm Success 5.32 test_vm_life_cycle.py
test_02_start_vm Success 15.34 test_vm_life_cycle.py
test_01_stop_vm Success 5.15 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 367.88 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 20.42 test_templates.py
test_03_delete_template Success 5.22 test_templates.py
test_02_edit_template Success 90.24 test_templates.py
test_01_create_template Success 181.75 test_templates.py
test_10_destroy_cpvm Success 263.21 test_ssvm.py
test_09_destroy_ssvm Success 264.73 test_ssvm.py
test_08_reboot_cpvm Success 156.61 test_ssvm.py
test_07_reboot_ssvm Success 158.60 test_ssvm.py
test_06_stop_cpvm Success 172.16 test_ssvm.py
test_05_stop_ssvm Success 179.54 test_ssvm.py
test_04_cpvm_internals Success 1.25 test_ssvm.py
test_03_ssvm_internals Success 3.79 test_ssvm.py
test_02_list_cpvm_vm Success 0.22 test_ssvm.py
test_01_list_sec_storage_vm Success 0.18 test_ssvm.py
test_01_snapshot_root_disk Success 27.85 test_snapshots.py
test_04_change_offering_small Success 92.24 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.09 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.33 test_secondary_storage.py
test_01_sys_vm_start Success 0.31 test_secondary_storage.py
test_09_reboot_router Success 121.28 test_routers.py
test_08_start_router Success 136.37 test_routers.py
test_07_stop_router Success 25.33 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.78 test_routers.py
test_03_restart_network_cleanup Success 162.20 test_routers.py
test_02_router_internal_adv Success 1.16 test_routers.py
test_01_router_internal_basic Success 0.59 test_routers.py
test_router_dhcphosts Success 143.26 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.23 test_resource_detail.py
test_01_reset_vm_on_reboot Success 30.62 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.23 test_pvlan.py
test_dedicatePublicIpRange Success 0.83 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 938.94 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 906.95 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 692.49 test_privategw_acl.py
test_01_vpc_privategw_acl Success 189.75 test_privategw_acl.py
test_01_primary_storage_nfs Success 37.36 test_primary_storage.py
test_createPortablePublicIPRange Success 15.63 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.52 test_portable_publicip.py
test_isolate_network_password_server Success 60.54 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.51 test_non_contigiousvlan.py
test_01_nic Success 820.15 test_nic.py
test_releaseIP Success 310.27 test_network.py
test_reboot_router Success 541.80 test_network.py
test_public_ip_user_account Success 10.25 test_network.py
test_public_ip_admin_account Success 40.34 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.50 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.12 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.64 test_network.py
test_delete_account Success 299.32 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.75 test_network.py
test_01_port_fwd_on_src_nat Success 112.03 test_network.py
test_nic_secondaryip_add_remove Success 209.64 test_multipleips_per_nic.py
login_test_saml_user Success 26.65 test_login.py
test_assign_and_removal_lb Success 133.60 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.69 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 188.12 test_loadbalance.py
test_07_list_default_iso Success 0.38 test_iso.py
test_05_iso_permissions Success 0.12 test_iso.py
test_04_extract_Iso Success 5.30 test_iso.py
test_03_delete_iso Success 95.23 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 22.08 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 612.67 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 330.57 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 874.31 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 784.21 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.39 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.15 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 65.96 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 156.93 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 171.78 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 25.98 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 157.51 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.78 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 7.47 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 7.05 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 189.36 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 358.86 test_affinity_groups.py
test_08_resize_volume Skipped 5.10 test_volumes.py
test_07_resize_fail Skipped 10.39 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 33.77 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.05 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@yadvr
Copy link
Member Author

yadvr commented Nov 23, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Nov 23, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Nov 23, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-235

@yadvr
Copy link
Member Author

yadvr commented Nov 23, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Nov 23, 2016

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@yadvr
Copy link
Member Author

yadvr commented Nov 24, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Nov 24, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Nov 24, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-249

@yadvr
Copy link
Member Author

yadvr commented Nov 25, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Nov 25, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Nov 25, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-256

@yadvr
Copy link
Member Author

yadvr commented Nov 25, 2016

@blueorangutan test

@blueorangutan
Copy link

blueorangutan commented Nov 25, 2016

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Nov 26, 2016

Trillian test result (tid-448)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 25923 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t448-kvm-centos7.zip
Test completed. 40 look ok, 3 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 225.85 test_vpc_redundant.py
test_router_dhcp_opts Failure 21.52 test_router_dhcphosts.py
test_10_attachAndDetach_iso Error 31.95 test_vm_life_cycle.py
test_01_vpc_site2site_vpn Success 175.75 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 66.32 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 272.10 test_vpc_vpn.py
test_02_VPC_default_routes Success 291.33 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 628.02 test_vpc_router_nics.py
test_04_rvpc_network_garbage_collector_nics Success 1488.84 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 397.40 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 758.02 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1318.41 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.61 test_volumes.py
test_08_resize_volume Success 15.51 test_volumes.py
test_07_resize_fail Success 20.57 test_volumes.py
test_06_download_detached_volume Success 15.35 test_volumes.py
test_05_detach_volume Success 100.29 test_volumes.py
test_04_delete_attached_volume Success 10.30 test_volumes.py
test_03_download_attached_volume Success 15.29 test_volumes.py
test_02_attach_volume Success 45.05 test_volumes.py
test_01_create_volume Success 719.28 test_volumes.py
test_deploy_vm_multiple Success 254.09 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_09_expunge_vm Success 125.38 test_vm_life_cycle.py
test_08_migrate_vm Success 41.32 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 126.06 test_vm_life_cycle.py
test_03_reboot_vm Success 126.51 test_vm_life_cycle.py
test_02_start_vm Success 10.21 test_vm_life_cycle.py
test_01_stop_vm Success 40.41 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 81.05 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.20 test_templates.py
test_03_delete_template Success 5.14 test_templates.py
test_02_edit_template Success 90.22 test_templates.py
test_01_create_template Success 55.65 test_templates.py
test_10_destroy_cpvm Success 131.86 test_ssvm.py
test_09_destroy_ssvm Success 168.59 test_ssvm.py
test_08_reboot_cpvm Success 101.64 test_ssvm.py
test_07_reboot_ssvm Success 133.72 test_ssvm.py
test_06_stop_cpvm Success 131.85 test_ssvm.py
test_05_stop_ssvm Success 133.97 test_ssvm.py
test_04_cpvm_internals Success 1.19 test_ssvm.py
test_03_ssvm_internals Success 3.43 test_ssvm.py
test_02_list_cpvm_vm Success 0.24 test_ssvm.py
test_01_list_sec_storage_vm Success 0.25 test_ssvm.py
test_01_snapshot_root_disk Success 12.24 test_snapshots.py
test_04_change_offering_small Success 209.86 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.09 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.22 test_secondary_storage.py
test_01_sys_vm_start Success 0.27 test_secondary_storage.py
test_09_reboot_router Success 40.39 test_routers.py
test_08_start_router Success 30.32 test_routers.py
test_07_stop_router Success 10.47 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.06 test_routers.py
test_04_restart_network_wo_cleanup Success 5.72 test_routers.py
test_03_restart_network_cleanup Success 55.84 test_routers.py
test_02_router_internal_adv Success 1.06 test_routers.py
test_01_router_internal_basic Success 0.59 test_routers.py
test_router_dhcphosts Success 278.66 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.09 test_resource_detail.py
test_01_reset_vm_on_reboot Success 161.37 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.21 test_pvlan.py
test_dedicatePublicIpRange Success 0.39 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 535.22 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 483.32 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 424.11 test_privategw_acl.py
test_01_vpc_privategw_acl Success 103.59 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.81 test_primary_storage.py
test_createPortablePublicIPRange Success 15.40 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.54 test_portable_publicip.py
test_isolate_network_password_server Success 89.79 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.45 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.34 test_non_contigiousvlan.py
test_01_nic Success 723.55 test_nic.py
test_releaseIP Success 270.27 test_network.py
test_reboot_router Success 400.26 test_network.py
test_public_ip_user_account Success 10.63 test_network.py
test_public_ip_admin_account Success 40.26 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.00 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.86 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.29 test_network.py
test_delete_account Success 274.23 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.86 test_network.py
test_01_port_fwd_on_src_nat Success 112.30 test_network.py
test_nic_secondaryip_add_remove Success 239.15 test_multipleips_per_nic.py
login_test_saml_user Success 24.59 test_login.py
test_assign_and_removal_lb Success 133.68 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.21 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 199.39 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.17 test_iso.py
test_03_delete_iso Success 95.30 test_iso.py
test_02_edit_iso Success 0.10 test_iso.py
test_01_create_iso Success 21.90 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 250.71 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 194.11 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 579.75 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 491.84 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.71 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.32 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 20.93 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 46.23 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 70.90 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.39 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 116.55 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 7.00 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 7.63 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 249.67 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 213.76 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 111.87 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@yadvr
Copy link
Member Author

yadvr commented Nov 27, 2016

@murali-reddy can you check why test_router_dhcp_opts (test_router_dhcphosts.py) failed, this test is failing intermittently on 4.9, master as well.

@yadvr
Copy link
Member Author

yadvr commented Nov 28, 2016

@blueorangutan package

@yadvr
Copy link
Member Author

yadvr commented Dec 2, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 2, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 2, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-317

@yadvr
Copy link
Member Author

yadvr commented Dec 2, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Dec 2, 2016

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Dec 3, 2016

Trillian test result (tid-563)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28652 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t563-kvm-centos7.zip
Test completed. 42 look ok, 1 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 917.38 test_vpc_redundant.py
test_01_vpc_site2site_vpn Success 180.83 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 81.60 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 298.96 test_vpc_vpn.py
test_02_VPC_default_routes Success 277.46 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 651.44 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 551.47 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1383.69 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 614.40 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1379.40 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.98 test_volumes.py
test_08_resize_volume Success 15.73 test_volumes.py
test_07_resize_fail Success 20.70 test_volumes.py
test_06_download_detached_volume Success 15.37 test_volumes.py
test_05_detach_volume Success 100.29 test_volumes.py
test_04_delete_attached_volume Success 10.41 test_volumes.py
test_03_download_attached_volume Success 15.44 test_volumes.py
test_02_attach_volume Success 43.77 test_volumes.py
test_01_create_volume Success 653.55 test_volumes.py
test_deploy_vm_multiple Success 275.32 test_vm_life_cycle.py
test_deploy_vm Success 0.06 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.19 test_vm_life_cycle.py
test_09_expunge_vm Success 125.23 test_vm_life_cycle.py
test_08_migrate_vm Success 36.44 test_vm_life_cycle.py
test_07_restore_vm Success 0.13 test_vm_life_cycle.py
test_06_destroy_vm Success 126.06 test_vm_life_cycle.py
test_03_reboot_vm Success 125.97 test_vm_life_cycle.py
test_02_start_vm Success 10.30 test_vm_life_cycle.py
test_01_stop_vm Success 40.42 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 166.60 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 5.24 test_templates.py
test_03_delete_template Success 5.21 test_templates.py
test_02_edit_template Success 90.10 test_templates.py
test_01_create_template Success 50.77 test_templates.py
test_10_destroy_cpvm Success 131.67 test_ssvm.py
test_09_destroy_ssvm Success 163.86 test_ssvm.py
test_08_reboot_cpvm Success 101.42 test_ssvm.py
test_07_reboot_ssvm Success 133.69 test_ssvm.py
test_06_stop_cpvm Success 161.74 test_ssvm.py
test_05_stop_ssvm Success 134.11 test_ssvm.py
test_04_cpvm_internals Success 1.01 test_ssvm.py
test_03_ssvm_internals Success 3.82 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 16.48 test_snapshots.py
test_04_change_offering_small Success 212.86 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.19 test_secondary_storage.py
test_01_sys_vm_start Success 0.39 test_secondary_storage.py
test_09_reboot_router Success 35.44 test_routers.py
test_08_start_router Success 25.33 test_routers.py
test_07_stop_router Success 10.20 test_routers.py
test_06_router_advanced Success 0.09 test_routers.py
test_05_router_basic Success 0.06 test_routers.py
test_04_restart_network_wo_cleanup Success 5.68 test_routers.py
test_03_restart_network_cleanup Success 101.09 test_routers.py
test_02_router_internal_adv Success 1.20 test_routers.py
test_01_router_internal_basic Success 0.63 test_routers.py
test_router_dhcphosts Success 283.26 test_router_dhcphosts.py
test_router_dhcp_opts Success 22.02 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.14 test_resource_detail.py
test_01_reset_vm_on_reboot Success 131.25 test_reset_vm_on_reboot.py
test_createRegion Success 0.08 test_regions.py
test_create_pvlan_network Success 5.40 test_pvlan.py
test_dedicatePublicIpRange Success 1.20 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 523.87 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 674.70 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 433.76 test_privategw_acl.py
test_01_vpc_privategw_acl Success 109.78 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.95 test_primary_storage.py
test_createPortablePublicIPRange Success 10.43 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.88 test_portable_publicip.py
test_isolate_network_password_server Success 91.56 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.31 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.36 test_non_contigiousvlan.py
test_01_nic Success 668.99 test_nic.py
test_releaseIP Success 169.16 test_network.py
test_reboot_router Success 460.71 test_network.py
test_public_ip_user_account Success 10.27 test_network.py
test_public_ip_admin_account Success 40.48 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.40 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.89 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 155.21 test_network.py
test_delete_account Success 356.17 test_network.py
test_02_port_fwd_on_non_src_nat Success 56.30 test_network.py
test_01_port_fwd_on_src_nat Success 108.92 test_network.py
test_nic_secondaryip_add_remove Success 224.71 test_multipleips_per_nic.py
login_test_saml_user Success 26.78 test_login.py
test_assign_and_removal_lb Success 134.57 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.38 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 189.67 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.42 test_iso.py
test_03_delete_iso Success 95.28 test_iso.py
test_02_edit_iso Success 0.11 test_iso.py
test_01_create_iso Success 21.96 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 264.41 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 214.21 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 557.71 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 478.35 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.56 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.34 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.08 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 20.66 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.95 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 116.85 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.46 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 126.34 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 7.92 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 7.20 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 274.89 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 274.56 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 81.60 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Dec 3, 2016

Trillian test result (tid-562)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 33660 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t562-xenserver-65sp1.zip
Test completed. 42 look ok, 1 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 426.69 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1367.70 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 526.94 test_vpc_redundant.py
test_01_vpc_site2site_vpn Success 311.91 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 157.29 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 528.47 test_vpc_vpn.py
test_02_VPC_default_routes Success 377.06 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 726.38 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 836.24 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1025.60 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.85 test_volumes.py
test_08_resize_volume Success 91.14 test_volumes.py
test_07_resize_fail Success 96.11 test_volumes.py
test_06_download_detached_volume Success 25.47 test_volumes.py
test_05_detach_volume Success 100.39 test_volumes.py
test_04_delete_attached_volume Success 10.25 test_volumes.py
test_03_download_attached_volume Success 15.49 test_volumes.py
test_02_attach_volume Success 11.27 test_volumes.py
test_01_create_volume Success 397.97 test_volumes.py
test_03_delete_vm_snapshots Success 280.29 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 186.59 test_vm_snapshots.py
test_01_create_vm_snapshots Success 131.93 test_vm_snapshots.py
test_deploy_vm_multiple Success 264.53 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.28 test_vm_life_cycle.py
test_09_expunge_vm Success 125.28 test_vm_life_cycle.py
test_08_migrate_vm Success 66.36 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 10.18 test_vm_life_cycle.py
test_03_reboot_vm Success 15.22 test_vm_life_cycle.py
test_02_start_vm Success 25.33 test_vm_life_cycle.py
test_01_stop_vm Success 30.31 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 121.51 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.24 test_templates.py
test_03_delete_template Success 5.15 test_templates.py
test_02_edit_template Success 90.12 test_templates.py
test_01_create_template Success 75.94 test_templates.py
test_10_destroy_cpvm Success 226.77 test_ssvm.py
test_09_destroy_ssvm Success 234.50 test_ssvm.py
test_08_reboot_cpvm Success 111.49 test_ssvm.py
test_07_reboot_ssvm Success 153.72 test_ssvm.py
test_06_stop_cpvm Success 136.94 test_ssvm.py
test_05_stop_ssvm Success 170.57 test_ssvm.py
test_04_cpvm_internals Success 1.04 test_ssvm.py
test_03_ssvm_internals Success 3.43 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 27.00 test_snapshots.py
test_04_change_offering_small Success 76.10 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.14 test_service_offerings.py
test_01_create_service_offering Success 0.16 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.22 test_secondary_storage.py
test_01_scale_vm Success 5.29 test_scale_vm.py
test_09_reboot_router Success 65.64 test_routers.py
test_08_start_router Success 60.64 test_routers.py
test_07_stop_router Success 15.25 test_routers.py
test_06_router_advanced Success 0.07 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.43 test_routers.py
test_03_restart_network_cleanup Success 131.21 test_routers.py
test_02_router_internal_adv Success 0.79 test_routers.py
test_01_router_internal_basic Success 0.30 test_routers.py
test_router_dhcphosts Success 137.74 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.34 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.17 test_resource_detail.py
test_01_reset_vm_on_reboot Success 121.28 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.37 test_pvlan.py
test_dedicatePublicIpRange Success 0.69 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 944.45 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 922.74 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 565.97 test_privategw_acl.py
test_01_vpc_privategw_acl Success 175.19 test_privategw_acl.py
test_01_primary_storage_nfs Success 39.08 test_primary_storage.py
test_01_primary_storage_iscsi Success 78.33 test_primary_storage.py
test_createPortablePublicIPRange Success 15.28 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.79 test_portable_publicip.py
test_isolate_network_password_server Success 61.33 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.20 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.39 test_non_contigiousvlan.py
test_01_nic Success 840.76 test_nic.py
test_releaseIP Success 290.11 test_network.py
test_reboot_router Success 627.97 test_network.py
test_public_ip_user_account Success 10.37 test_network.py
test_public_ip_admin_account Success 40.42 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 77.15 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.79 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 91.89 test_network.py
test_delete_account Success 325.50 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.91 test_network.py
test_01_port_fwd_on_src_nat Success 78.91 test_network.py
test_nic_secondaryip_add_remove Success 209.39 test_multipleips_per_nic.py
login_test_saml_user Success 25.42 test_login.py
test_assign_and_removal_lb Success 149.60 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 202.65 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 203.79 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.21 test_iso.py
test_03_delete_iso Success 95.24 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 22.32 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 521.78 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 365.57 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 896.35 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 635.92 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.48 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.22 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.15 test_disk_offerings.py
test_03_delete_disk_offering Success 0.08 test_disk_offerings.py
test_02_edit_disk_offering Success 0.11 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.11 test_disk_offerings.py
test_01_create_disk_offering Success 0.14 test_disk_offerings.py
test_deployvm_userdispersing Success 46.41 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 141.87 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 232.90 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 15.66 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 161.87 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.82 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.86 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 7.09 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 154.06 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 167.44 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Dec 3, 2016

Trillian test result (tid-564)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35570 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t564-vmware-55u3.zip
Test completed. 39 look ok, 4 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Error 432.52 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 650.22 test_vpc_vpn.py
test_CreateTemplateWithDuplicateName Error 242.69 test_templates.py
test_01_create_template Error 35.50 test_templates.py
ContextSuite context=TestTemplates>:setup Error 600.96 test_templates.py
test_01_snapshot_root_disk Error 20.37 test_snapshots.py
test_04_extract_Iso Error 5.12 test_iso.py
test_01_vpc_remote_access_vpn Success 142.48 test_vpc_vpn.py
test_02_VPC_default_routes Success 320.00 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 708.88 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 520.20 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1492.28 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 604.40 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 610.02 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1207.78 test_vpc_redundant.py
test_09_delete_detached_volume Success 31.92 test_volumes.py
test_06_download_detached_volume Success 86.26 test_volumes.py
test_05_detach_volume Success 105.52 test_volumes.py
test_04_delete_attached_volume Success 20.62 test_volumes.py
test_03_download_attached_volume Success 25.46 test_volumes.py
test_02_attach_volume Success 58.91 test_volumes.py
test_01_create_volume Success 461.32 test_volumes.py
test_03_delete_vm_snapshots Success 280.25 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 194.24 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 247.67 test_vm_snapshots.py
test_01_create_vm_snapshots Success 158.71 test_vm_snapshots.py
test_deploy_vm_multiple Success 239.44 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.85 test_vm_life_cycle.py
test_09_expunge_vm Success 185.30 test_vm_life_cycle.py
test_08_migrate_vm Success 86.95 test_vm_life_cycle.py
test_07_restore_vm Success 0.11 test_vm_life_cycle.py
test_06_destroy_vm Success 10.24 test_vm_life_cycle.py
test_03_reboot_vm Success 5.17 test_vm_life_cycle.py
test_02_start_vm Success 20.29 test_vm_life_cycle.py
test_01_stop_vm Success 5.26 test_vm_life_cycle.py
test_10_destroy_cpvm Success 267.20 test_ssvm.py
test_09_destroy_ssvm Success 269.82 test_ssvm.py
test_08_reboot_cpvm Success 156.82 test_ssvm.py
test_07_reboot_ssvm Success 159.30 test_ssvm.py
test_06_stop_cpvm Success 207.85 test_ssvm.py
test_05_stop_ssvm Success 210.09 test_ssvm.py
test_04_cpvm_internals Success 1.62 test_ssvm.py
test_03_ssvm_internals Success 6.13 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_04_change_offering_small Success 98.50 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.32 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.21 test_secondary_storage.py
test_09_reboot_router Success 141.66 test_routers.py
test_08_start_router Success 111.34 test_routers.py
test_07_stop_router Success 20.37 test_routers.py
test_06_router_advanced Success 0.09 test_routers.py
test_05_router_basic Success 0.07 test_routers.py
test_04_restart_network_wo_cleanup Success 5.96 test_routers.py
test_03_restart_network_cleanup Success 146.77 test_routers.py
test_02_router_internal_adv Success 1.38 test_routers.py
test_01_router_internal_basic Success 1.05 test_routers.py
test_router_dhcphosts Success 158.71 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.95 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.26 test_resource_detail.py
test_01_reset_vm_on_reboot Success 60.70 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.31 test_pvlan.py
test_dedicatePublicIpRange Success 0.48 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 1131.27 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 890.46 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 671.92 test_privategw_acl.py
test_01_vpc_privategw_acl Success 159.73 test_privategw_acl.py
test_01_primary_storage_nfs Success 36.42 test_primary_storage.py
test_createPortablePublicIPRange Success 10.47 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.77 test_portable_publicip.py
test_isolate_network_password_server Success 95.14 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.17 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.57 test_non_contigiousvlan.py
test_01_nic Success 745.01 test_nic.py
test_releaseIP Success 259.96 test_network.py
test_reboot_router Success 627.39 test_network.py
test_public_ip_user_account Success 10.37 test_network.py
test_public_ip_admin_account Success 40.48 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.13 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.36 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 128.71 test_network.py
test_delete_account Success 402.36 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.84 test_network.py
test_01_port_fwd_on_src_nat Success 112.10 test_network.py
test_nic_secondaryip_add_remove Success 350.75 test_multipleips_per_nic.py
login_test_saml_user Success 26.78 test_login.py
test_assign_and_removal_lb Success 137.26 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.36 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 189.23 test_loadbalance.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.09 test_iso.py
test_03_delete_iso Success 95.25 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.98 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 602.40 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 481.67 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1011.21 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 730.08 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.32 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 66.03 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 121.93 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 227.63 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 136.90 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 167.04 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.75 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 8.20 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.94 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 199.07 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 244.16 test_affinity_groups.py
test_08_resize_volume Skipped 10.23 test_volumes.py
test_07_resize_fail Skipped 15.41 test_volumes.py
test_01_scale_vm Skipped 63.28 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@borisstoyanov
Copy link
Contributor

borisstoyanov commented Dec 5, 2016

Xen and KVM test runs seem not have introduced any new failure,
regarding vmware:
test_temaplate errors seem to be caused by a timeout issue
com.cloud.exception.OperationTimedoutException: Commands 241787004994453513 to Host 5 timed out after 1800'
test_snapshots - failed to create snapshot due to internal error.
test_iso - Unable to create a link for entity at template/tmpl/16/206/206-16-f0a23a90-3c64-3bf3-8495-7dd3f83f59ec.iso on ssvm,No remote endpoint to send command, check if host or ssvm is down?' maybe resource was down at that point for some reason...

I'll deploy a test bed to verify them manually now.
cc: @rhtyd

@yadvr
Copy link
Member Author

yadvr commented Dec 7, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 7, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 7, 2016

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-339

@yadvr
Copy link
Member Author

yadvr commented Dec 7, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 7, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 7, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-344

@yadvr
Copy link
Member Author

yadvr commented Dec 9, 2016

@blueorangutan test

@blueorangutan
Copy link

blueorangutan commented Dec 9, 2016

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Dec 9, 2016

Trillian test result (tid-642)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 26785 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t642-kvm-centos7.zip
Test completed. 43 look ok, 0 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Success 187.19 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 81.47 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 282.92 test_vpc_vpn.py
test_02_VPC_default_routes Success 310.15 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 541.34 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 535.78 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1493.07 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 556.95 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 790.07 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1371.73 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.79 test_volumes.py
test_08_resize_volume Success 15.55 test_volumes.py
test_07_resize_fail Success 20.62 test_volumes.py
test_06_download_detached_volume Success 15.41 test_volumes.py
test_05_detach_volume Success 100.30 test_volumes.py
test_04_delete_attached_volume Success 10.24 test_volumes.py
test_03_download_attached_volume Success 15.38 test_volumes.py
test_02_attach_volume Success 44.70 test_volumes.py
test_01_create_volume Success 737.27 test_volumes.py
test_deploy_vm_multiple Success 294.44 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.06 test_vm_life_cycle.py
test_09_expunge_vm Success 125.15 test_vm_life_cycle.py
test_08_migrate_vm Success 41.45 test_vm_life_cycle.py
test_07_restore_vm Success 0.23 test_vm_life_cycle.py
test_06_destroy_vm Success 126.19 test_vm_life_cycle.py
test_03_reboot_vm Success 125.93 test_vm_life_cycle.py
test_02_start_vm Success 10.25 test_vm_life_cycle.py
test_01_stop_vm Success 40.45 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 61.21 test_templates.py
test_08_list_system_templates Success 0.10 test_templates.py
test_07_list_public_templates Success 0.05 test_templates.py
test_05_template_permissions Success 0.09 test_templates.py
test_04_extract_template Success 5.26 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.19 test_templates.py
test_01_create_template Success 65.84 test_templates.py
test_10_destroy_cpvm Success 161.66 test_ssvm.py
test_09_destroy_ssvm Success 194.32 test_ssvm.py
test_08_reboot_cpvm Success 101.70 test_ssvm.py
test_07_reboot_ssvm Success 133.70 test_ssvm.py
test_06_stop_cpvm Success 161.86 test_ssvm.py
test_05_stop_ssvm Success 134.01 test_ssvm.py
test_04_cpvm_internals Success 1.17 test_ssvm.py
test_03_ssvm_internals Success 3.31 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.21 test_ssvm.py
test_01_snapshot_root_disk Success 16.61 test_snapshots.py
test_04_change_offering_small Success 210.32 test_service_offerings.py
test_03_delete_service_offering Success 0.11 test_service_offerings.py
test_02_edit_service_offering Success 0.21 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.19 test_secondary_storage.py
test_09_reboot_router Success 35.49 test_routers.py
test_08_start_router Success 30.53 test_routers.py
test_07_stop_router Success 10.19 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.79 test_routers.py
test_03_restart_network_cleanup Success 65.77 test_routers.py
test_02_router_internal_adv Success 1.05 test_routers.py
test_01_router_internal_basic Success 0.56 test_routers.py
test_router_dhcphosts Success 317.87 test_router_dhcphosts.py
test_router_dhcp_opts Success 22.63 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.09 test_resource_detail.py
test_01_reset_vm_on_reboot Success 161.41 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.22 test_pvlan.py
test_dedicatePublicIpRange Success 0.39 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 555.15 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 533.61 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 404.82 test_privategw_acl.py
test_01_vpc_privategw_acl Success 93.50 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.93 test_primary_storage.py
test_createPortablePublicIPRange Success 15.44 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.50 test_portable_publicip.py
test_isolate_network_password_server Success 89.75 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.29 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.36 test_non_contigiousvlan.py
test_01_nic Success 698.52 test_nic.py
test_releaseIP Success 302.08 test_network.py
test_reboot_router Success 395.45 test_network.py
test_public_ip_user_account Success 10.31 test_network.py
test_public_ip_admin_account Success 40.37 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.03 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.93 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 154.32 test_network.py
test_delete_account Success 275.24 test_network.py
test_02_port_fwd_on_non_src_nat Success 56.02 test_network.py
test_01_port_fwd_on_src_nat Success 111.87 test_network.py
test_nic_secondaryip_add_remove Success 209.02 test_multipleips_per_nic.py
login_test_saml_user Success 26.22 test_login.py
test_assign_and_removal_lb Success 133.70 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.69 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 188.52 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.32 test_iso.py
test_03_delete_iso Success 95.19 test_iso.py
test_02_edit_iso Success 0.08 test_iso.py
test_01_create_iso Success 21.87 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 320.64 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 193.64 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 557.67 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 482.19 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.59 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.38 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 20.77 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.74 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 85.95 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.43 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 56.22 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 7.96 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.88 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 223.91 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 254.60 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 77.24 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@yadvr
Copy link
Member Author

yadvr commented Dec 9, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 9, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 9, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-381

@yadvr
Copy link
Member Author

yadvr commented Dec 11, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 11, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 11, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-387

@yadvr
Copy link
Member Author

yadvr commented Dec 11, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Dec 11, 2016

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Dec 12, 2016

Trillian test result (tid-656)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 26120 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t656-kvm-centos7.zip
Test completed. 43 look ok, 0 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Success 159.78 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 65.99 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 295.53 test_vpc_vpn.py
test_02_VPC_default_routes Success 305.13 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 543.59 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 527.29 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1336.01 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 583.86 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 770.84 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1323.55 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.41 test_volumes.py
test_08_resize_volume Success 15.58 test_volumes.py
test_07_resize_fail Success 20.42 test_volumes.py
test_06_download_detached_volume Success 15.29 test_volumes.py
test_05_detach_volume Success 100.23 test_volumes.py
test_04_delete_attached_volume Success 10.15 test_volumes.py
test_03_download_attached_volume Success 15.34 test_volumes.py
test_02_attach_volume Success 73.74 test_volumes.py
test_01_create_volume Success 750.52 test_volumes.py
test_deploy_vm_multiple Success 277.96 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.11 test_vm_life_cycle.py
test_09_expunge_vm Success 125.20 test_vm_life_cycle.py
test_08_migrate_vm Success 41.55 test_vm_life_cycle.py
test_07_restore_vm Success 0.09 test_vm_life_cycle.py
test_06_destroy_vm Success 125.87 test_vm_life_cycle.py
test_03_reboot_vm Success 126.07 test_vm_life_cycle.py
test_02_start_vm Success 10.12 test_vm_life_cycle.py
test_01_stop_vm Success 40.29 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 105.73 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.02 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 5.13 test_templates.py
test_03_delete_template Success 5.09 test_templates.py
test_02_edit_template Success 90.14 test_templates.py
test_01_create_template Success 85.66 test_templates.py
test_10_destroy_cpvm Success 191.47 test_ssvm.py
test_09_destroy_ssvm Success 193.59 test_ssvm.py
test_08_reboot_cpvm Success 161.61 test_ssvm.py
test_07_reboot_ssvm Success 134.75 test_ssvm.py
test_06_stop_cpvm Success 191.90 test_ssvm.py
test_05_stop_ssvm Success 134.17 test_ssvm.py
test_04_cpvm_internals Success 1.23 test_ssvm.py
test_03_ssvm_internals Success 3.98 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_01_snapshot_root_disk Success 11.54 test_snapshots.py
test_04_change_offering_small Success 239.47 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.04 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.08 test_secondary_storage.py
test_01_sys_vm_start Success 0.13 test_secondary_storage.py
test_09_reboot_router Success 35.36 test_routers.py
test_08_start_router Success 35.41 test_routers.py
test_07_stop_router Success 10.19 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.68 test_routers.py
test_03_restart_network_cleanup Success 75.60 test_routers.py
test_02_router_internal_adv Success 1.02 test_routers.py
test_01_router_internal_basic Success 0.55 test_routers.py
test_router_dhcphosts Success 277.42 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.74 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.09 test_resource_detail.py
test_01_reset_vm_on_reboot Success 166.06 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.30 test_pvlan.py
test_dedicatePublicIpRange Success 0.52 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 627.97 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 516.49 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 371.14 test_privategw_acl.py
test_01_vpc_privategw_acl Success 87.61 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.68 test_primary_storage.py
test_createPortablePublicIPRange Success 5.23 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.42 test_portable_publicip.py
test_isolate_network_password_server Success 86.68 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.11 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.35 test_non_contigiousvlan.py
test_01_nic Success 712.04 test_nic.py
test_releaseIP Success 258.21 test_network.py
test_reboot_router Success 423.88 test_network.py
test_public_ip_user_account Success 10.22 test_network.py
test_public_ip_admin_account Success 40.38 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.68 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.65 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.90 test_network.py
test_delete_account Success 353.62 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.58 test_network.py
test_01_port_fwd_on_src_nat Success 111.74 test_network.py
test_nic_secondaryip_add_remove Success 207.66 test_multipleips_per_nic.py
login_test_saml_user Success 22.02 test_login.py
test_assign_and_removal_lb Success 138.40 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.31 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 187.60 test_loadbalance.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.17 test_iso.py
test_03_delete_iso Success 95.19 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 21.38 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 227.91 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 182.94 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 559.69 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 490.21 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.20 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.10 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.04 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.03 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.07 test_disk_offerings.py
test_deployvm_userdispersing Success 20.49 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 45.65 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.85 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.27 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 60.60 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.39 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.24 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 227.80 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 263.19 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 116.05 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Dec 12, 2016

Trillian test result (tid-658)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 29908 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t658-xenserver-65sp1.zip
Test completed. 40 look ok, 3 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 237.87 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 227.75 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Failure 253.76 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Failure 243.02 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 252.92 test_vpc_redundant.py
test_01_vpc_site2site_vpn Error 888.24 test_vpc_vpn.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
test_05_rvpc_multi_tiers Error 278.33 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Error 268.23 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Error 294.32 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Error 283.55 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Error 293.41 test_vpc_redundant.py
test_reboot_router Error 514.33 test_network.py
test_01_vpc_remote_access_vpn Success 161.50 test_vpc_vpn.py
test_02_VPC_default_routes Success 299.74 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 681.27 test_vpc_router_nics.py
test_09_delete_detached_volume Success 20.71 test_volumes.py
test_08_resize_volume Success 110.91 test_volumes.py
test_07_resize_fail Success 111.09 test_volumes.py
test_06_download_detached_volume Success 20.30 test_volumes.py
test_05_detach_volume Success 105.27 test_volumes.py
test_04_delete_attached_volume Success 15.19 test_volumes.py
test_03_download_attached_volume Success 20.56 test_volumes.py
test_02_attach_volume Success 18.38 test_volumes.py
test_01_create_volume Success 398.67 test_volumes.py
test_03_delete_vm_snapshots Success 280.24 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 191.42 test_vm_snapshots.py
test_01_create_vm_snapshots Success 138.98 test_vm_snapshots.py
test_deploy_vm_multiple Success 303.08 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 31.69 test_vm_life_cycle.py
test_09_expunge_vm Success 125.23 test_vm_life_cycle.py
test_08_migrate_vm Success 60.91 test_vm_life_cycle.py
test_07_restore_vm Success 0.12 test_vm_life_cycle.py
test_06_destroy_vm Success 10.43 test_vm_life_cycle.py
test_03_reboot_vm Success 10.14 test_vm_life_cycle.py
test_02_start_vm Success 20.20 test_vm_life_cycle.py
test_01_stop_vm Success 30.25 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 135.95 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.02 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 5.22 test_templates.py
test_03_delete_template Success 5.09 test_templates.py
test_02_edit_template Success 90.14 test_templates.py
test_01_create_template Success 75.60 test_templates.py
test_10_destroy_cpvm Success 226.70 test_ssvm.py
test_09_destroy_ssvm Success 203.93 test_ssvm.py
test_08_reboot_cpvm Success 141.71 test_ssvm.py
test_07_reboot_ssvm Success 154.03 test_ssvm.py
test_06_stop_cpvm Success 166.87 test_ssvm.py
test_05_stop_ssvm Success 174.84 test_ssvm.py
test_04_cpvm_internals Success 1.03 test_ssvm.py
test_03_ssvm_internals Success 3.87 test_ssvm.py
test_02_list_cpvm_vm Success 0.10 test_ssvm.py
test_01_list_sec_storage_vm Success 0.10 test_ssvm.py
test_01_snapshot_root_disk Success 26.27 test_snapshots.py
test_04_change_offering_small Success 86.25 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.09 test_secondary_storage.py
test_01_sys_vm_start Success 0.15 test_secondary_storage.py
test_01_scale_vm Success 5.20 test_scale_vm.py
test_09_reboot_router Success 75.50 test_routers.py
test_08_start_router Success 50.40 test_routers.py
test_07_stop_router Success 15.17 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.49 test_routers.py
test_03_restart_network_cleanup Success 140.88 test_routers.py
test_02_router_internal_adv Success 0.78 test_routers.py
test_01_router_internal_basic Success 0.41 test_routers.py
test_router_dhcphosts Success 102.54 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.15 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.07 test_resource_detail.py
test_01_reset_vm_on_reboot Success 100.67 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.18 test_pvlan.py
test_dedicatePublicIpRange Success 0.41 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 965.05 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 888.03 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 587.59 test_privategw_acl.py
test_01_vpc_privategw_acl Success 153.41 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.63 test_primary_storage.py
test_01_primary_storage_iscsi Success 78.05 test_primary_storage.py
test_createPortablePublicIPRange Success 15.18 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.55 test_portable_publicip.py
test_isolate_network_password_server Success 64.87 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.28 test_non_contigiousvlan.py
test_01_nic Success 817.47 test_nic.py
test_releaseIP Success 323.56 test_network.py
test_public_ip_user_account Success 10.24 test_network.py
test_public_ip_admin_account Success 40.27 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 71.49 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.35 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 92.00 test_network.py
test_delete_account Success 238.38 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.60 test_network.py
test_01_port_fwd_on_src_nat Success 78.95 test_network.py
test_nic_secondaryip_add_remove Success 182.70 test_multipleips_per_nic.py
login_test_saml_user Success 21.57 test_login.py
test_assign_and_removal_lb Success 139.07 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 202.64 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 200.82 test_loadbalance.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.05 test_iso.py
test_04_extract_Iso Success 5.41 test_iso.py
test_03_delete_iso Success 95.14 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 21.37 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 533.05 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 379.43 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 877.88 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 776.44 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.25 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.16 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.09 test_disk_offerings.py
test_deployvm_userdispersing Success 40.59 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 116.03 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 166.16 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 25.48 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 105.92 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.31 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.19 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.33 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 192.78 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 251.85 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Dec 12, 2016

Trillian test result (tid-659)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34773 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1752-t659-vmware-55u3.zip
Test completed. 41 look ok, 2 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Error 451.14 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 667.83 test_vpc_vpn.py
test_03_vpc_privategw_restart_vpc_cleanup Error 1099.91 test_privategw_acl.py
test_01_vpc_remote_access_vpn Success 151.40 test_vpc_vpn.py
test_02_VPC_default_routes Success 347.47 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 832.46 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 598.25 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1538.23 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 680.84 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 594.01 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1270.25 test_vpc_redundant.py
test_09_delete_detached_volume Success 36.34 test_volumes.py
test_06_download_detached_volume Success 70.75 test_volumes.py
test_05_detach_volume Success 105.27 test_volumes.py
test_04_delete_attached_volume Success 15.31 test_volumes.py
test_03_download_attached_volume Success 20.27 test_volumes.py
test_02_attach_volume Success 83.71 test_volumes.py
test_01_create_volume Success 527.52 test_volumes.py
test_03_delete_vm_snapshots Success 275.16 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 194.36 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 216.49 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.71 test_vm_snapshots.py
test_deploy_vm_multiple Success 232.58 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.01 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 32.11 test_vm_life_cycle.py
test_09_expunge_vm Success 125.19 test_vm_life_cycle.py
test_08_migrate_vm Success 75.93 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 10.11 test_vm_life_cycle.py
test_03_reboot_vm Success 5.19 test_vm_life_cycle.py
test_02_start_vm Success 20.23 test_vm_life_cycle.py
test_01_stop_vm Success 5.08 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 377.34 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.02 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 20.89 test_templates.py
test_03_delete_template Success 5.08 test_templates.py
test_02_edit_template Success 90.11 test_templates.py
test_01_create_template Success 146.12 test_templates.py
test_10_destroy_cpvm Success 267.19 test_ssvm.py
test_09_destroy_ssvm Success 239.09 test_ssvm.py
test_08_reboot_cpvm Success 186.38 test_ssvm.py
test_07_reboot_ssvm Success 158.62 test_ssvm.py
test_06_stop_cpvm Success 212.33 test_ssvm.py
test_05_stop_ssvm Success 209.47 test_ssvm.py
test_04_cpvm_internals Success 1.02 test_ssvm.py
test_03_ssvm_internals Success 3.21 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_01_snapshot_root_disk Success 26.95 test_snapshots.py
test_04_change_offering_small Success 98.66 test_service_offerings.py
test_03_delete_service_offering Success 0.02 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.26 test_service_offerings.py
test_02_sys_template_ready Success 0.09 test_secondary_storage.py
test_01_sys_vm_start Success 0.12 test_secondary_storage.py
test_09_reboot_router Success 140.79 test_routers.py
test_08_start_router Success 140.91 test_routers.py
test_07_stop_router Success 25.19 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.55 test_routers.py
test_03_restart_network_cleanup Success 161.17 test_routers.py
test_02_router_internal_adv Success 0.87 test_routers.py
test_01_router_internal_basic Success 0.46 test_routers.py
test_router_dhcphosts Success 189.14 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.31 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.05 test_resource_detail.py
test_01_reset_vm_on_reboot Success 140.95 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.21 test_pvlan.py
test_dedicatePublicIpRange Success 0.28 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 1092.95 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 622.89 test_privategw_acl.py
test_01_vpc_privategw_acl Success 188.25 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.36 test_primary_storage.py
test_createPortablePublicIPRange Success 15.15 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.66 test_portable_publicip.py
test_isolate_network_password_server Success 92.36 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.45 test_non_contigiousvlan.py
test_01_nic Success 811.71 test_nic.py
test_releaseIP Success 283.17 test_network.py
test_reboot_router Success 656.68 test_network.py
test_public_ip_user_account Success 10.38 test_network.py
test_public_ip_admin_account Success 40.31 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.72 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.87 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.22 test_network.py
test_delete_account Success 287.80 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.55 test_network.py
test_01_port_fwd_on_src_nat Success 112.20 test_network.py
test_nic_secondaryip_add_remove Success 228.42 test_multipleips_per_nic.py
login_test_saml_user Success 21.53 test_login.py
test_assign_and_removal_lb Success 133.73 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.17 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 188.04 test_loadbalance.py
test_07_list_default_iso Success 0.08 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.56 test_iso.py
test_03_delete_iso Success 95.19 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 41.32 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 666.49 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 514.34 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 958.47 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 737.27 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.23 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.22 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.07 test_disk_offerings.py
test_deployvm_userdispersing Success 60.78 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 90.97 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 196.22 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.69 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 181.58 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.19 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.46 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.26 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 258.86 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 196.51 test_affinity_groups.py
test_08_resize_volume Skipped 10.12 test_volumes.py
test_07_resize_fail Skipped 15.33 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 66.52 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@yadvr yadvr closed this Dec 16, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@yadvr @blueorangutan @borisstoyanov