Skip to content

Conversation

@abhinandanprateek
Copy link
Contributor

… are about converting int/long time values to joda Duration.

@abhinandanprateek
Copy link
Contributor Author

Moved PR from 4.9 (#1678) to 4.8 here.

@abhinandanprateek
Copy link
Contributor Author

@karuturi I guess jenkins' failure is due to env ?
"ERROR: Step ‘Archive the artifacts’ failed: no workspace for cloudstack-pr-analysis #2184"

@rohityadavcloud
Copy link
Member

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-118

@rohityadavcloud
Copy link
Member

@blueorangutan test

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@jburwell
Copy link
Contributor

jburwell commented Nov 1, 2016

@abhinandanprateek the Jenkins build failed. Could you please investigate?

@abhinandanprateek
Copy link
Contributor Author

@jburwell The reason is ""ERROR: Step ‘Archive the artifacts’ failed: no workspace for cloudstack-pr-analysis #2184""
I will force push again.

… are about converting int/long time values to joda Duration.
@blueorangutan
Copy link

Trillian test result (tid-237)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 24826 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t237-kvm-centos7.zip
Test completed. 42 look ok, 1 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 876.11 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 366.45 test_vpc_redundant.py
test_01_vpc_site2site_vpn Success 166.15 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 61.76 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 276.72 test_vpc_vpn.py
test_02_VPC_default_routes Success 315.94 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 527.78 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 517.54 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1367.12 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 629.06 test_vpc_redundant.py
test_09_delete_detached_volume Success 11.25 test_volumes.py
test_08_resize_volume Success 15.54 test_volumes.py
test_07_resize_fail Success 20.58 test_volumes.py
test_06_download_detached_volume Success 15.31 test_volumes.py
test_05_detach_volume Success 100.28 test_volumes.py
test_04_delete_attached_volume Success 10.23 test_volumes.py
test_03_download_attached_volume Success 15.38 test_volumes.py
test_02_attach_volume Success 43.97 test_volumes.py
test_01_create_volume Success 622.90 test_volumes.py
test_deploy_vm_multiple Success 239.86 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.54 test_vm_life_cycle.py
test_09_expunge_vm Success 125.25 test_vm_life_cycle.py
test_08_migrate_vm Success 41.44 test_vm_life_cycle.py
test_07_restore_vm Success 0.21 test_vm_life_cycle.py
test_06_destroy_vm Success 126.01 test_vm_life_cycle.py
test_03_reboot_vm Success 125.97 test_vm_life_cycle.py
test_02_start_vm Success 10.17 test_vm_life_cycle.py
test_01_stop_vm Success 40.35 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 126.06 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.32 test_templates.py
test_03_delete_template Success 5.13 test_templates.py
test_02_edit_template Success 90.12 test_templates.py
test_01_create_template Success 60.85 test_templates.py
test_10_destroy_cpvm Success 196.67 test_ssvm.py
test_09_destroy_ssvm Success 225.04 test_ssvm.py
test_08_reboot_cpvm Success 101.71 test_ssvm.py
test_07_reboot_ssvm Success 133.13 test_ssvm.py
test_06_stop_cpvm Success 131.72 test_ssvm.py
test_05_stop_ssvm Success 134.76 test_ssvm.py
test_04_cpvm_internals Success 1.20 test_ssvm.py
test_03_ssvm_internals Success 2.89 test_ssvm.py
test_02_list_cpvm_vm Success 0.10 test_ssvm.py
test_01_list_sec_storage_vm Success 0.11 test_ssvm.py
test_01_snapshot_root_disk Success 11.27 test_snapshots.py
test_04_change_offering_small Success 204.65 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.15 test_secondary_storage.py
test_09_reboot_router Success 45.40 test_routers.py
test_08_start_router Success 35.29 test_routers.py
test_07_stop_router Success 10.24 test_routers.py
test_06_router_advanced Success 0.15 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.77 test_routers.py
test_03_restart_network_cleanup Success 55.70 test_routers.py
test_02_router_internal_adv Success 1.15 test_routers.py
test_01_router_internal_basic Success 0.60 test_routers.py
test_router_dhcphosts Success 241.55 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.07 test_resource_detail.py
test_01_reset_vm_on_reboot Success 161.38 test_reset_vm_on_reboot.py
test_createRegion Success 0.07 test_regions.py
test_create_pvlan_network Success 5.23 test_pvlan.py
test_dedicatePublicIpRange Success 0.39 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 499.98 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 473.03 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 397.05 test_privategw_acl.py
test_01_vpc_privategw_acl Success 113.90 test_privategw_acl.py
test_01_primary_storage_nfs Success 36.03 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.55 test_portable_publicip.py
test_isolate_network_password_server Success 89.44 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.28 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.32 test_non_contigiousvlan.py
test_01_nic Success 773.11 test_nic.py
test_releaseIP Success 194.53 test_network.py
test_reboot_router Success 435.69 test_network.py
test_public_ip_user_account Success 10.46 test_network.py
test_public_ip_admin_account Success 40.43 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.15 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.80 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.98 test_network.py
test_delete_account Success 269.59 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.85 test_network.py
test_01_port_fwd_on_src_nat Success 108.75 test_network.py
test_nic_secondaryip_add_remove Success 220.17 test_multipleips_per_nic.py
login_test_saml_user Success 26.82 test_login.py
test_assign_and_removal_lb Success 134.67 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.46 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 188.86 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.49 test_iso.py
test_03_delete_iso Success 95.24 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 21.89 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 360.46 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 239.19 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 552.41 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 486.28 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.26 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.57 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.09 test_disk_offerings.py
test_deployvm_userdispersing Success 20.79 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 56.39 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 45.90 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.41 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 66.17 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 7.82 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.96 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 239.16 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 203.44 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 111.63 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.09 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member

The following will run an additional component tests:
@blueorangutan test centos7 kvm-centos7 component/test_routers.py component/test_acl_isolatednetwork.py component/test_add_remove_network.py component/test_network_offering.py component/test_persistent_networks.py

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-263)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30880 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t263-kvm-centos7.zip

Additional tests completed. 1 look ok, 0 have error(s)

Test Result Time (s) Test File

@rohityadavcloud
Copy link
Member

There was an issue with the additionaltests script that caused no outputs in the last comment. I've re-kicked the tests now.

@blueorangutan
Copy link

Trillian test result (tid-275)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28972 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t275-kvm-centos7.zip
Test completed. 42 look ok, 1 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 870.32 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 376.01 test_vpc_redundant.py
test_01_vpc_site2site_vpn Success 171.12 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 87.25 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 277.82 test_vpc_vpn.py
test_02_VPC_default_routes Success 296.83 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 551.72 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 525.09 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1463.08 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 554.08 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.77 test_volumes.py
test_08_resize_volume Success 15.55 test_volumes.py
test_07_resize_fail Success 20.56 test_volumes.py
test_06_download_detached_volume Success 15.37 test_volumes.py
test_05_detach_volume Success 100.28 test_volumes.py
test_04_delete_attached_volume Success 10.24 test_volumes.py
test_03_download_attached_volume Success 15.38 test_volumes.py
test_02_attach_volume Success 45.92 test_volumes.py
test_01_create_volume Success 711.89 test_volumes.py
test_deploy_vm_multiple Success 330.35 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.99 test_vm_life_cycle.py
test_09_expunge_vm Success 125.28 test_vm_life_cycle.py
test_08_migrate_vm Success 36.01 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 131.06 test_vm_life_cycle.py
test_03_reboot_vm Success 125.94 test_vm_life_cycle.py
test_02_start_vm Success 10.27 test_vm_life_cycle.py
test_01_stop_vm Success 40.40 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 91.05 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 5.22 test_templates.py
test_03_delete_template Success 5.21 test_templates.py
test_02_edit_template Success 90.30 test_templates.py
test_01_create_template Success 56.55 test_templates.py
test_10_destroy_cpvm Success 161.80 test_ssvm.py
test_09_destroy_ssvm Success 225.07 test_ssvm.py
test_08_reboot_cpvm Success 161.72 test_ssvm.py
test_07_reboot_ssvm Success 134.01 test_ssvm.py
test_06_stop_cpvm Success 131.63 test_ssvm.py
test_05_stop_ssvm Success 133.90 test_ssvm.py
test_04_cpvm_internals Success 1.20 test_ssvm.py
test_03_ssvm_internals Success 3.34 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.16 test_ssvm.py
test_01_snapshot_root_disk Success 11.55 test_snapshots.py
test_04_change_offering_small Success 210.64 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.23 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.15 test_secondary_storage.py
test_09_reboot_router Success 35.58 test_routers.py
test_08_start_router Success 30.29 test_routers.py
test_07_stop_router Success 10.26 test_routers.py
test_06_router_advanced Success 0.11 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.76 test_routers.py
test_03_restart_network_cleanup Success 60.63 test_routers.py
test_02_router_internal_adv Success 0.99 test_routers.py
test_01_router_internal_basic Success 0.54 test_routers.py
test_router_dhcphosts Success 277.96 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.28 test_resource_detail.py
test_01_reset_vm_on_reboot Success 156.22 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.20 test_pvlan.py
test_dedicatePublicIpRange Success 0.37 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 538.23 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 489.68 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 383.19 test_privategw_acl.py
test_01_vpc_privategw_acl Success 94.30 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.70 test_primary_storage.py
test_createPortablePublicIPRange Success 20.31 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.62 test_portable_publicip.py
test_isolate_network_password_server Success 90.28 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.14 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.55 test_non_contigiousvlan.py
test_01_nic Success 834.23 test_nic.py
test_releaseIP Success 271.25 test_network.py
test_reboot_router Success 409.80 test_network.py
test_public_ip_user_account Success 10.23 test_network.py
test_public_ip_admin_account Success 40.32 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.88 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.84 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.15 test_network.py
test_delete_account Success 304.48 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.72 test_network.py
test_01_port_fwd_on_src_nat Success 112.09 test_network.py
test_nic_secondaryip_add_remove Success 208.52 test_multipleips_per_nic.py
login_test_saml_user Success 27.00 test_login.py
test_assign_and_removal_lb Success 133.36 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.09 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 198.04 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.17 test_iso.py
test_03_delete_iso Success 95.16 test_iso.py
test_02_edit_iso Success 0.09 test_iso.py
test_01_create_iso Success 22.27 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 243.53 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 188.51 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 557.05 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 482.20 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.37 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.22 test_disk_offerings.py
test_03_delete_disk_offering Success 0.09 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.22 test_disk_offerings.py
test_01_create_disk_offering Success 0.28 test_disk_offerings.py
test_deployvm_userdispersing Success 25.76 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.87 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 96.43 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.63 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 50.71 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 7.63 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.86 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 294.86 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 228.85 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 71.05 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

Additional tests completed. 1 look ok, 0 have error(s)

Test Result Time (s) Test File
test_01_RouterStopCreateFW Failure 45.96 test_routers.py
ContextSuite context=TestVPCNetworkOperations>:setup Error 0.00 test_persistent_networks.py
ContextSuite context=TestRestartPersistentNetwork>:setup Error 0.00 test_persistent_networks.py
ContextSuite context=TestProjectAccountOperations>:setup Error 0.00 test_persistent_networks.py
ContextSuite context=TestPersistentNetworks>:setup Error 0.00 test_persistent_networks.py
ContextSuite context=TestAssignVirtualMachine>:setup Error 0.00 test_persistent_networks.py
ContextSuite context=TestNOWithOnlySourceNAT>:setup Error 0.00 test_network_offering.py
ContextSuite context=TestNOVirtualRouter>:setup Error 0.00 test_network_offering.py
ContextSuite context=TestUpdateVirtualMachineNIC>:setup Error 0.00 test_add_remove_network.py
ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setup Error 0.00 test_add_remove_network.py
ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup Error 0.00 test_add_remove_network.py
ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup Error 0.00 test_add_remove_network.py
ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup Error 0.00 test_add_remove_network.py
ContextSuite context=TestAddNetworkToVirtualMachine>:setup Error 0.00 test_add_remove_network.py
ContextSuite context=TestIsolatedNetwork>:teardown Error 534.18 test_acl_isolatednetwork.py
test_03_RouterStartOnVmDeploy Success 35.66 test_routers.py
test_02_NetworkGarbageCollection Success 861.15 test_routers.py
test_01_RouterStopCreatePF Success 82.15 test_routers.py
test_01_RouterStopCreateLB Success 86.37 test_routers.py
test_01_AdvancedZoneRouterServices Success 0.12 test_routers.py
test_30_restartNetwork_user_foruserinotherdomain Success 0.01 test_acl_isolatednetwork.py
test_29_restartNetwork_user_foruserinsamedomain Success 0.01 test_acl_isolatednetwork.py
test_28_restartNetwork_user Success 75.57 test_acl_isolatednetwork.py
test_27_restartNetwork_domaindmin_forcrossdomainuser Success 0.01 test_acl_isolatednetwork.py
test_26_restartNetwork_domaindmin_foruserinsubdomain Success 70.61 test_acl_isolatednetwork.py
test_25_restartNetwork_domaindmin_foruserinsamedomain Success 70.67 test_acl_isolatednetwork.py
test_24_restartNetwork_domaindmin Success 70.59 test_acl_isolatednetwork.py
test_23_restartNetwork_admin_foruserinotherdomain Success 80.55 test_acl_isolatednetwork.py
test_22_restartNetwork_admin_foruserinsamedomain Success 85.73 test_acl_isolatednetwork.py
test_21_restartNetwork_admin Success 85.78 test_acl_isolatednetwork.py
test_20_deployvm_user_foruserincrossdomain Success 0.05 test_acl_isolatednetwork.py
test_20_1_deployvm_user_incrossnetwork Success 0.09 test_acl_isolatednetwork.py
test_19_deployvm_user_foruserinsamedomain Success 0.03 test_acl_isolatednetwork.py
test_18_deployvm_user Success 10.26 test_acl_isolatednetwork.py
test_17_deployvm_domaindmin_forcrossdomainuser Success 0.02 test_acl_isolatednetwork.py
test_17_1_deployvm_domainadmin_foruserinotherdomain_crossnetwork Success 0.05 test_acl_isolatednetwork.py
test_16_deployvm_domaindmin_foruserinsubdomain Success 10.30 test_acl_isolatednetwork.py
test_15_deployvm_domaindmin_foruserinsamedomain Success 10.45 test_acl_isolatednetwork.py
test_14_deployvm_domaindmin Success 10.28 test_acl_isolatednetwork.py
test_13_deployvm_admin_foruserinotherdomain Success 10.27 test_acl_isolatednetwork.py
test_13_1_deployvm_admin_foruserinotherdomain_crossnetwork Success 0.03 test_acl_isolatednetwork.py
test_12_deployvm_admin_foruserinsamedomain Success 10.43 test_acl_isolatednetwork.py
test_11_deployvm_admin Success 10.23 test_acl_isolatednetwork.py
test_10_createNetwork_user_foruserinotherdomain Success 0.03 test_acl_isolatednetwork.py
test_09_createNetwork_user_foruserinsamedomain Success 0.03 test_acl_isolatednetwork.py
test_08_createNetwork_user Success 0.09 test_acl_isolatednetwork.py
test_07_createNetwork_domaindmin_forcrossdomainuser Success 0.03 test_acl_isolatednetwork.py
test_06_createNetwork_domaindmin_foruserinsubdomain Success 0.10 test_acl_isolatednetwork.py
test_05_createNetwork_domaindmin_foruserinsamedomain Success 0.10 test_acl_isolatednetwork.py
test_04_createNetwork_domaindmin Success 0.10 test_acl_isolatednetwork.py
test_03_createNetwork_admin_foruserinotherdomain Success 0.11 test_acl_isolatednetwork.py
test_02_createNetwork_admin_foruserinsamedomain Success 0.10 test_acl_isolatednetwork.py
test_01_createNetwork_admin Success 0.10 test_acl_isolatednetwork.py

@karuturi
Copy link
Member

karuturi commented Nov 4, 2016

@blueorangutan test matrix component/test_routers.py component/test_acl_isolatednetwork.py component/test_add_remove_network.py component/test_network_offering.py component/test_persistent_networks.py

@karuturi
Copy link
Member

karuturi commented Nov 4, 2016

@blueorangutan help

@blueorangutan
Copy link

@karuturi I understand these words: "help", "hello", "thanks", "package", "test"
Test command usage: test [mgmt os] [hypervisor] [additional tests]
Mgmt OS options: ['centos6', 'centos7', 'ubuntu']
Hypervisor options: ['kvm-centos6', 'kvm-centos7', 'kvm-ubuntu', 'xenserver-65sp1', 'xenserver-62sp1', 'vmware-60u2', 'vmware-55u3', 'vmware-51u1', 'vmware-50u1']
Additional tests: list of comma separated tests with paths relative to the test/integration directory, for example: component/test_acl_listvm.py, component/test_volumes.py
Note: when additional tests are passed, you need to specify mgmt server os and hypervisor or use the matrix command.

Blessed contributors for kicking Trillian test jobs: ['rhtyd', 'jburwell', 'murali-reddy', 'abhinandanprateek', 'PaulAngus', 'borisstoyanov', 'karuturi']

@karuturi
Copy link
Member

karuturi commented Nov 4, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

@karuturi a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-297)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 24264 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t297-kvm-centos7.zip
Test completed. 43 look ok, 0 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Success 161.36 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 61.22 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 221.10 test_vpc_vpn.py
test_02_VPC_default_routes Success 264.34 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 550.99 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 507.26 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1440.30 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 555.47 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 750.05 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1287.92 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.56 test_volumes.py
test_08_resize_volume Success 15.56 test_volumes.py
test_07_resize_fail Success 20.52 test_volumes.py
test_06_download_detached_volume Success 15.34 test_volumes.py
test_05_detach_volume Success 100.36 test_volumes.py
test_04_delete_attached_volume Success 10.20 test_volumes.py
test_03_download_attached_volume Success 15.34 test_volumes.py
test_02_attach_volume Success 43.69 test_volumes.py
test_01_create_volume Success 754.30 test_volumes.py
test_deploy_vm_multiple Success 238.93 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.91 test_vm_life_cycle.py
test_09_expunge_vm Success 125.26 test_vm_life_cycle.py
test_08_migrate_vm Success 35.98 test_vm_life_cycle.py
test_07_restore_vm Success 0.25 test_vm_life_cycle.py
test_06_destroy_vm Success 125.98 test_vm_life_cycle.py
test_03_reboot_vm Success 126.04 test_vm_life_cycle.py
test_02_start_vm Success 10.16 test_vm_life_cycle.py
test_01_stop_vm Success 40.41 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 75.67 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.12 test_templates.py
test_03_delete_template Success 5.21 test_templates.py
test_02_edit_template Success 90.15 test_templates.py
test_01_create_template Success 71.14 test_templates.py
test_10_destroy_cpvm Success 131.36 test_ssvm.py
test_09_destroy_ssvm Success 169.15 test_ssvm.py
test_08_reboot_cpvm Success 131.33 test_ssvm.py
test_07_reboot_ssvm Success 133.65 test_ssvm.py
test_06_stop_cpvm Success 101.43 test_ssvm.py
test_05_stop_ssvm Success 133.91 test_ssvm.py
test_04_cpvm_internals Success 0.97 test_ssvm.py
test_03_ssvm_internals Success 3.20 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.11 test_ssvm.py
test_01_snapshot_root_disk Success 11.36 test_snapshots.py
test_04_change_offering_small Success 210.00 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.07 test_service_offerings.py
test_01_create_service_offering Success 0.09 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.15 test_secondary_storage.py
test_09_reboot_router Success 35.33 test_routers.py
test_08_start_router Success 35.29 test_routers.py
test_07_stop_router Success 10.15 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.55 test_routers.py
test_03_restart_network_cleanup Success 65.59 test_routers.py
test_02_router_internal_adv Success 1.05 test_routers.py
test_01_router_internal_basic Success 0.61 test_routers.py
test_router_dhcphosts Success 242.28 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 131.07 test_reset_vm_on_reboot.py
test_createRegion Success 0.07 test_regions.py
test_create_pvlan_network Success 5.19 test_pvlan.py
test_dedicatePublicIpRange Success 0.39 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 513.50 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 497.62 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 373.27 test_privategw_acl.py
test_01_vpc_privategw_acl Success 83.84 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.79 test_primary_storage.py
test_createPortablePublicIPRange Success 15.17 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.65 test_portable_publicip.py
test_isolate_network_password_server Success 57.07 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.26 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.27 test_non_contigiousvlan.py
test_01_nic Success 809.43 test_nic.py
test_releaseIP Success 289.91 test_network.py
test_reboot_router Success 390.57 test_network.py
test_public_ip_user_account Success 10.41 test_network.py
test_public_ip_admin_account Success 40.23 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.70 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.72 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.92 test_network.py
test_delete_account Success 309.28 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.84 test_network.py
test_01_port_fwd_on_src_nat Success 111.73 test_network.py
test_nic_secondaryip_add_remove Success 203.93 test_multipleips_per_nic.py
login_test_saml_user Success 26.53 test_login.py
test_assign_and_removal_lb Success 133.14 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 186.96 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 187.84 test_loadbalance.py
test_07_list_default_iso Success 0.08 test_iso.py
test_05_iso_permissions Success 0.13 test_iso.py
test_04_extract_Iso Success 5.19 test_iso.py
test_03_delete_iso Success 95.19 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 22.81 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 229.11 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 178.28 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 555.75 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 472.67 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.29 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.09 test_disk_offerings.py
test_deployvm_userdispersing Success 21.42 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.82 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 70.85 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.42 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 45.66 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.95 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 7.64 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 225.60 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 205.41 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 106.26 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-296)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 30497 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t296-xenserver-65sp1.zip
Test completed. 40 look ok, 3 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 430.81 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1321.49 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 509.68 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 695.38 test_privategw_acl.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
test_01_vpc_site2site_vpn Success 297.61 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 126.66 test_vpc_vpn.py
test_02_VPC_default_routes Success 321.25 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 617.60 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 826.96 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 983.75 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.73 test_volumes.py
test_08_resize_volume Success 101.07 test_volumes.py
test_07_resize_fail Success 106.15 test_volumes.py
test_06_download_detached_volume Success 25.58 test_volumes.py
test_05_detach_volume Success 100.50 test_volumes.py
test_04_delete_attached_volume Success 10.26 test_volumes.py
test_03_download_attached_volume Success 15.36 test_volumes.py
test_02_attach_volume Success 10.75 test_volumes.py
test_01_create_volume Success 392.36 test_volumes.py
test_03_delete_vm_snapshots Success 280.28 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 186.45 test_vm_snapshots.py
test_01_create_vm_snapshots Success 133.79 test_vm_snapshots.py
test_deploy_vm_multiple Success 178.57 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.79 test_vm_life_cycle.py
test_09_expunge_vm Success 125.25 test_vm_life_cycle.py
test_08_migrate_vm Success 61.43 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 10.16 test_vm_life_cycle.py
test_03_reboot_vm Success 15.21 test_vm_life_cycle.py
test_02_start_vm Success 20.26 test_vm_life_cycle.py
test_01_stop_vm Success 30.39 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 111.11 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.18 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.23 test_templates.py
test_01_create_template Success 60.71 test_templates.py
test_10_destroy_cpvm Success 196.59 test_ssvm.py
test_09_destroy_ssvm Success 198.92 test_ssvm.py
test_08_reboot_cpvm Success 146.66 test_ssvm.py
test_07_reboot_ssvm Success 148.65 test_ssvm.py
test_06_stop_cpvm Success 136.78 test_ssvm.py
test_05_stop_ssvm Success 169.13 test_ssvm.py
test_04_cpvm_internals Success 1.14 test_ssvm.py
test_03_ssvm_internals Success 3.70 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_01_snapshot_root_disk Success 31.75 test_snapshots.py
test_04_change_offering_small Success 74.09 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_01_scale_vm Success 5.27 test_scale_vm.py
test_09_reboot_router Success 55.46 test_routers.py
test_08_start_router Success 45.45 test_routers.py
test_07_stop_router Success 15.21 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.52 test_routers.py
test_03_restart_network_cleanup Success 115.99 test_routers.py
test_02_router_internal_adv Success 0.79 test_routers.py
test_01_router_internal_basic Success 0.42 test_routers.py
test_router_dhcphosts Success 132.82 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.14 test_resource_detail.py
test_01_reset_vm_on_reboot Success 80.75 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.29 test_pvlan.py
test_dedicatePublicIpRange Success 0.60 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 790.08 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 523.89 test_privategw_acl.py
test_01_vpc_privategw_acl Success 138.97 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.76 test_primary_storage.py
test_01_primary_storage_iscsi Success 80.83 test_primary_storage.py
test_createPortablePublicIPRange Success 15.24 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.58 test_portable_publicip.py
test_isolate_network_password_server Success 61.14 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.20 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.38 test_non_contigiousvlan.py
test_01_nic Success 930.68 test_nic.py
test_releaseIP Success 204.36 test_network.py
test_reboot_router Success 546.85 test_network.py
test_public_ip_user_account Success 10.28 test_network.py
test_public_ip_admin_account Success 40.38 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 71.79 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.25 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 92.69 test_network.py
test_delete_account Success 304.25 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.79 test_network.py
test_01_port_fwd_on_src_nat Success 78.86 test_network.py
test_nic_secondaryip_add_remove Success 128.33 test_multipleips_per_nic.py
login_test_saml_user Success 24.88 test_login.py
test_assign_and_removal_lb Success 143.82 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 192.51 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 193.16 test_loadbalance.py
test_07_list_default_iso Success 0.08 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.16 test_iso.py
test_03_delete_iso Success 95.25 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.96 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 451.31 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 336.24 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 894.62 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 674.38 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.35 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.20 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.08 test_disk_offerings.py
test_01_create_disk_offering Success 0.14 test_disk_offerings.py
test_deployvm_userdispersing Success 35.90 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.33 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 166.57 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 15.68 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 111.44 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.97 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.83 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 7.00 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 173.71 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 192.09 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-298)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31109 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t298-vmware-55u3.zip
Test completed. 40 look ok, 3 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Error 441.25 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 662.47 test_vpc_vpn.py
test_CreateTemplateWithDuplicateName Error 181.25 test_templates.py
test_01_create_template Error 25.19 test_templates.py
ContextSuite context=TestTemplates>:setup Error 481.87 test_templates.py
test_01_snapshot_root_disk Error 10.15 test_snapshots.py
test_01_vpc_remote_access_vpn Success 151.56 test_vpc_vpn.py
test_02_VPC_default_routes Success 327.66 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 656.65 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 495.85 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1514.10 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 633.79 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 528.85 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1142.68 test_vpc_redundant.py
test_09_delete_detached_volume Success 30.79 test_volumes.py
test_06_download_detached_volume Success 50.54 test_volumes.py
test_05_detach_volume Success 105.33 test_volumes.py
test_04_delete_attached_volume Success 20.20 test_volumes.py
test_03_download_attached_volume Success 15.27 test_volumes.py
test_02_attach_volume Success 53.65 test_volumes.py
test_01_create_volume Success 513.52 test_volumes.py
test_03_delete_vm_snapshots Success 275.27 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 189.06 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 151.28 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.62 test_vm_snapshots.py
test_deploy_vm_multiple Success 247.87 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.01 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 21.73 test_vm_life_cycle.py
test_09_expunge_vm Success 185.30 test_vm_life_cycle.py
test_08_migrate_vm Success 61.33 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 10.12 test_vm_life_cycle.py
test_03_reboot_vm Success 5.10 test_vm_life_cycle.py
test_02_start_vm Success 20.17 test_vm_life_cycle.py
test_01_stop_vm Success 10.14 test_vm_life_cycle.py
test_10_destroy_cpvm Success 226.55 test_ssvm.py
test_09_destroy_ssvm Success 238.43 test_ssvm.py
test_08_reboot_cpvm Success 156.27 test_ssvm.py
test_07_reboot_ssvm Success 158.45 test_ssvm.py
test_06_stop_cpvm Success 226.66 test_ssvm.py
test_05_stop_ssvm Success 173.74 test_ssvm.py
test_04_cpvm_internals Success 1.03 test_ssvm.py
test_03_ssvm_internals Success 3.90 test_ssvm.py
test_02_list_cpvm_vm Success 0.07 test_ssvm.py
test_01_list_sec_storage_vm Success 0.07 test_ssvm.py
test_04_change_offering_small Success 96.90 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.19 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.13 test_secondary_storage.py
test_09_reboot_router Success 165.90 test_routers.py
test_08_start_router Success 120.75 test_routers.py
test_07_stop_router Success 25.18 test_routers.py
test_06_router_advanced Success 0.03 test_routers.py
test_05_router_basic Success 0.02 test_routers.py
test_04_restart_network_wo_cleanup Success 5.54 test_routers.py
test_03_restart_network_cleanup Success 170.91 test_routers.py
test_02_router_internal_adv Success 1.09 test_routers.py
test_01_router_internal_basic Success 1.02 test_routers.py
test_router_dhcphosts Success 150.19 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.06 test_resource_detail.py
test_01_reset_vm_on_reboot Success 60.47 test_reset_vm_on_reboot.py
test_createRegion Success 0.07 test_regions.py
test_create_pvlan_network Success 5.14 test_pvlan.py
test_dedicatePublicIpRange Success 0.27 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 1049.83 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 912.04 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 561.44 test_privategw_acl.py
test_01_vpc_privategw_acl Success 188.04 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.55 test_primary_storage.py
test_createPortablePublicIPRange Success 15.37 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.43 test_portable_publicip.py
test_isolate_network_password_server Success 92.00 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.37 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.21 test_non_contigiousvlan.py
test_01_nic Success 821.60 test_nic.py
test_releaseIP Success 313.35 test_network.py
test_reboot_router Success 625.16 test_network.py
test_public_ip_user_account Success 10.16 test_network.py
test_public_ip_admin_account Success 40.30 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.62 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.63 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.67 test_network.py
test_delete_account Success 353.72 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.48 test_network.py
test_01_port_fwd_on_src_nat Success 111.68 test_network.py
test_nic_secondaryip_add_remove Success 223.56 test_multipleips_per_nic.py
login_test_saml_user Success 22.76 test_login.py
test_assign_and_removal_lb Success 133.64 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.05 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 187.89 test_loadbalance.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.22 test_iso.py
test_03_delete_iso Success 95.16 test_iso.py
test_02_edit_iso Success 0.03 test_iso.py
test_01_create_iso Success 21.36 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 590.32 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 355.54 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 929.59 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 757.90 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.31 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.09 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.04 test_disk_offerings.py
test_03_delete_disk_offering Success 0.02 test_disk_offerings.py
test_02_edit_disk_offering Success 0.03 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.04 test_disk_offerings.py
test_01_create_disk_offering Success 0.06 test_disk_offerings.py
test_deployvm_userdispersing Success 51.27 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 90.81 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 212.04 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.44 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 166.20 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.50 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.18 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.31 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 237.84 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 222.01 test_affinity_groups.py
test_08_resize_volume Skipped 5.18 test_volumes.py
test_07_resize_fail Skipped 10.39 test_volumes.py
test_01_scale_vm Skipped 66.31 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.02 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member

LGTM. Reviews -- @karuturi @jburwell @murali-reddy and others ?

@jburwell
Copy link
Contributor

jburwell commented Nov 8, 2016

@rhtyd we have the following failures in the blueoraguntan vmware run that were fixed as part of #1692:

  • test_CreateTemplateWithDuplicateName
  • test_01_create_template
  • ContextSuite context=TestTemplates>:setup

Do we have an explanation for these failures?

The other failures are related to redundant VPC which will be addressed in 4.9.2.0.

@rohityadavcloud
Copy link
Member

@jburwell I'm running tests on 4.8+ branches to see what tests may have regressed on these branches.
PR #1752 - 4.8
PR #1753 - 4.9
PR #1754 - 4.10

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-159

@jburwell
Copy link
Contributor

@rhtyd where do we stand determining the root cause of the test failures?

@rohityadavcloud
Copy link
Member

@blueorangutan package

@rohityadavcloud
Copy link
Member

@jburwell I'll need to rebuild packages, and re-run tests to see where we currently are.

@rohityadavcloud
Copy link
Member

@blueorangutan test

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-376)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 25923 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1745-t376-kvm-centos7.zip
Test completed. 43 look ok, 0 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Success 260.69 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 126.83 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 258.09 test_vpc_vpn.py
test_02_VPC_default_routes Success 331.81 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 534.70 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 526.50 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1449.74 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 573.28 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 763.84 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1289.88 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.59 test_volumes.py
test_08_resize_volume Success 15.37 test_volumes.py
test_07_resize_fail Success 20.56 test_volumes.py
test_06_download_detached_volume Success 15.39 test_volumes.py
test_05_detach_volume Success 100.31 test_volumes.py
test_04_delete_attached_volume Success 10.35 test_volumes.py
test_03_download_attached_volume Success 15.40 test_volumes.py
test_02_attach_volume Success 45.38 test_volumes.py
test_01_create_volume Success 720.17 test_volumes.py
test_deploy_vm_multiple Success 295.56 test_vm_life_cycle.py
test_deploy_vm Success 0.05 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.04 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.45 test_vm_life_cycle.py
test_09_expunge_vm Success 125.24 test_vm_life_cycle.py
test_08_migrate_vm Success 41.00 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 125.99 test_vm_life_cycle.py
test_03_reboot_vm Success 126.29 test_vm_life_cycle.py
test_02_start_vm Success 10.22 test_vm_life_cycle.py
test_01_stop_vm Success 40.43 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 80.79 test_templates.py
test_08_list_system_templates Success 0.07 test_templates.py
test_07_list_public_templates Success 0.05 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.17 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.16 test_templates.py
test_01_create_template Success 60.80 test_templates.py
test_10_destroy_cpvm Success 191.91 test_ssvm.py
test_09_destroy_ssvm Success 164.28 test_ssvm.py
test_08_reboot_cpvm Success 102.16 test_ssvm.py
test_07_reboot_ssvm Success 133.66 test_ssvm.py
test_06_stop_cpvm Success 131.78 test_ssvm.py
test_05_stop_ssvm Success 133.69 test_ssvm.py
test_04_cpvm_internals Success 1.22 test_ssvm.py
test_03_ssvm_internals Success 3.37 test_ssvm.py
test_02_list_cpvm_vm Success 0.11 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 11.54 test_snapshots.py
test_04_change_offering_small Success 209.95 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.20 test_secondary_storage.py
test_01_sys_vm_start Success 0.46 test_secondary_storage.py
test_09_reboot_router Success 35.39 test_routers.py
test_08_start_router Success 30.37 test_routers.py
test_07_stop_router Success 10.16 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.76 test_routers.py
test_03_restart_network_cleanup Success 60.56 test_routers.py
test_02_router_internal_adv Success 1.03 test_routers.py
test_01_router_internal_basic Success 0.59 test_routers.py
test_router_dhcphosts Success 303.16 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 131.07 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.28 test_pvlan.py
test_dedicatePublicIpRange Success 0.42 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 533.88 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 497.82 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 424.38 test_privategw_acl.py
test_01_vpc_privategw_acl Success 88.78 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.83 test_primary_storage.py
test_createPortablePublicIPRange Success 15.78 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.51 test_portable_publicip.py
test_isolate_network_password_server Success 90.04 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.15 test_over_provisioning.py
test_extendPhysicalNetworkVlan Success 15.33 test_non_contigiousvlan.py
test_01_nic Success 814.99 test_nic.py
test_releaseIP Success 250.66 test_network.py
test_reboot_router Success 451.29 test_network.py
test_public_ip_user_account Success 10.36 test_network.py
test_public_ip_admin_account Success 40.43 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.10 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.02 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.28 test_network.py
test_delete_account Success 279.39 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.99 test_network.py
test_01_port_fwd_on_src_nat Success 111.93 test_network.py
test_nic_secondaryip_add_remove Success 234.16 test_multipleips_per_nic.py
login_test_saml_user Success 26.74 test_login.py
test_assign_and_removal_lb Success 134.51 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 189.00 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 193.70 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.87 test_iso.py
test_03_delete_iso Success 95.21 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.91 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 285.96 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 230.34 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 576.04 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 503.76 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.29 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 20.96 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 51.37 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.73 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.44 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 101.23 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 8.14 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.87 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 244.14 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 213.69 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 66.36 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member

LGTM, merging this based on last test run and code reviews.

@asfgit asfgit merged commit 83b5a8b into apache:4.8 Nov 23, 2016
asfgit pushed a commit that referenced this pull request Nov 23, 2016
CLOUDSTACK-9503: Increased the VR script timeout. Most of the changes are about converting int/long time values to joda Duration.

* pr/1745:
  CLOUDSTACK-9503: Increased the VR script timeout. Most of the changes are about converting int/long time values to joda Duration.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants