Project ACRN Device Model architecture introduction

Project ACRN Device Model architecture introduction

• 1.
  ACRN Device ModelArchitecture Introduction Yuan LIU Liu, Yuan1 <yuan1.liu@intel.com> 03/25/2020
• 2.
  Agenda ❑Device Model Overview ❑DeviceModel Initialization ❑Device Emulation ❑ACPI Virtualization
• 3.
  Device Model Framework ACRNDevice Model (DM) is a QEMU-like application in SOS and it is responsible for creating a UOS VM and then performing devices emulation based on command line configurations.
• 4.
  Device Model Configuration acrn-dm-A -m 2048M -s 0:0,hostbridge -s 2,pci-gvt -G "64 448 8“ -s 5,virtio-blk,/home/clear/uos/uos.img -s 6,virtio-net,tap0 -s 7,passthru,0/15/1 --ovmf /usr/share/acrn/bios/OVMF.fd vm1 acrn-hypervisor/devicemodel/samples https://projectacrn.github.io/latest/user-guides/acrn-dm-parameters.html#acrn-dm-parameters
• 5.
  Agenda ❑Device Model Overview ❑DeviceModel Initialization ❑Device Emulation ❑ACPI Virtualization
• 6.
  Device Model BootingFlow Start DM Parse Option Create VM Setup IO Request Buffer Setup Memory Virtual Devices Init ACPI InitSW Load Start VM Loop Start Mevent Loop OVMF EFI bzImage vSBL UOS memory is allocated from SOS memory Huge TLB Open /dev/vhm IC_CREATE_VM vm_id Create I/O request client Handle IO Request VM Name UOS Memory Size Virtual Devices … Micro event Asynchronous message mechanism based on Linux epoll A page buffer allocated by DM, shared between DM, VHM service and HV. Build guest ACPI table Full tables RSDP, RSDT, XSDT, MADT, FADT, HPET, MCFG All emulated devices initialization
• 7.
  Virtual Device Initialization vISADevice Init vPCI Device Init Monitor Init MMIO Init PIO Init vPIRQ Init PIO Handler Register struct inout_port { const char *name; int port; int size; int flags; inout_func_t handler; void *arg; }; int register_inout(struct inout_port *iop); int unregister_inout(struct inout_port *iop); #define INOUT_PORT(name, port, flags, handler) MMIO Handler Register struct mem_range { const char *name; int flags; mem_func_t handler; void *arg1; long arg2; uint64_t base; uint64_t size; }; int register_mem(struct mem_range *memp); int unregister_mem(struct mem_range *memp);
• 8.
  Default Guest MemoryLayout 2G 0 3.5G 4G 64-bit PCI Hole RAM 5G 32-bit PCI Hole Low memory High memory RAM ACPI MMCFG IOAPIC HPET LAPCI acrn-hypervisor/devicemodel/core/sw_load_common.c
• 9.
  Agenda ❑Device Model Overview ❑DeviceModel Initialization ❑Device Emulation ❑ACPI Virtualization
• 10.
  Device Emulation ⚫ DeviceRegister • PCI Configuration Space • PORT IO • Memory Mapped IO ⚫ Interrupt • MSI/MSIX • INTX ⚫ Function Emulation
• 11.
  __set_pci_vdev_ops_set_sym_pci_ops_ahci Virtual PCI DeviceRegistration set_pci_vdev_ops_set Section struct pci_vdev_ops pci_ops_xhci = { .class_name = "xhci", .vdev_init = pci_xhci_init, .vdev_deinit = pci_xhci_deinit, .vdev_barwrite = pci_xhci_write, .vdev_barread = pci_xhci_read }; DEFINE_PCI_DEVTYPE(pci_ops_xhci); struct pci_vdev_ops pci_ops_wdt = { .class_name = "wdt-i6300esb", .vdev_init = pci_wdt_init, .vdev_deinit = pci_wdt_deinit, .vdev_cfgwrite = pci_wdt_cfg_write, .vdev_cfgread = pci_wdt_cfg_read, .vdev_barwrite = pci_wdt_bar_write, .vdev_barread = pci_wdt_bar_read }; DEFINE_PCI_DEVTYPE(pci_ops_wdt); __set_pci_vdev_ops_set_sym_pci_ops_wdt … .interp Section set_logger_dev_op Section … … acrn-dm Section Headers
• 12.
  Virtual PCI DeviceOperations struct pci_vdev_ops { char *class_name; /* Name of device class */ /* instance creation */ int (*vdev_init)(struct vmctx *, struct pci_vdev *, char *opts); /* instance deinit */ void (*vdev_deinit)(struct vmctx *, struct pci_vdev *, char *opts); /* ACPI DSDT enumeration */ void (*vdev_write_dsdt)(struct pci_vdev *); /* ops related to physical resources */ void (*vdev_phys_access)(struct vmctx *ctx, struct pci_vdev *dev); /* config space read/write callbacks */ int (*vdev_cfgwrite)(struct vmctx *ctx, int vcpu, struct pci_vdev *pi, int offset, int bytes, uint32_t val); int (*vdev_cfgread)(struct vmctx *ctx, int vcpu, struct pci_vdev *pi, int offset, int bytes, uint32_t *retval); /* BAR read/write callbacks */ void (*vdev_barwrite)(struct vmctx *ctx, int vcpu, struct pci_vdev *pi, int baridx, uint64_t offset, int size, uint64_t value); uint64_t (*vdev_barread)(struct vmctx *ctx, int vcpu, struct pci_vdev *pi, int baridx, uint64_t offset, int size); };
• 13.
  Virtual PCI DeviceConfiguration Space Virtual PCI device PCI Capability pci_set_cfgdata8 pci_set_cfgdata16 pci_set_cfgdata32 pci_emul_add_capability pci_emul_add_msicap pci_emul_add_msixcap pci_emul_alloc_bar pci_lintr_request
• 14.
  Virtual PCI Interrupt pci_generate_msi pci_generate_msix pci_lintr_assert pci_lintr_deassert v DeviceModel Virtual PCI Device (INTx or MSI) vLAPCI0 vLAPIC1 Virtual Interrupt HandlerHypervisor Service OS User OS vCPU0 vCPU1 vIOAPIC msi/msixmsi/msix
• 15.
  Port I/O EmulationFlow MMIO access flow is similar except for a VM exit reason of EPT violation. 8
• 16.
  Agenda ❑Device Model Overview ❑DeviceModel Initialization ❑Device Emulation ❑ACPI Virtualization
• 17.
  ACPI - AdvancedConfiguration and Power Interface Functions implemented by ACPI include: • System/Device/Processor power management • Device/Processor performance management • Configuration / Plug and Play • System event • Battery management • Thermal management
• 18.
  ACPI Table Virtualization acrn-hypervisor/devicemodel/hw/platform/acpi/acpi.c structpci_vdev_ops { ... /* ACPI DSDT enumeration */ void (*vdev_write_dsdt)(struct pci_vdev *); … };
• 19.
  References https://projectacrn.github.io/latest/developer-guides/hld/hld-devicemodel.html https://projectacrn.github.io/latest/developer-guides/hld/hv-io-emulation.html#hld-io-emulation https://projectacrn.github.io/latest/developer-guides/hld/hld-emulated-devices.html#
• 20.
  Q & A