Issues

• Illegal Instruction on CPU build

  inferflow/inferflow#53 · Filter by author clifflynt opened on Dec 11, 2024

• How to make Q8 inference faster?

  inferflow/inferflow#52 · Filter by author immocreat opened on Jun 7, 2024

• what does return_output_tensors parameter do in inferflow_service.ini

  inferflow/inferflow#51 · Filter by author ShadowTeamCN opened on Jun 6, 2024

• Do you have quantitative comparisons on inference metrics with other popular inference engines?

  inferflow/inferflow#50 · Filter by author immocreat opened on Jun 2, 2024

• Does opt_13b model support tensor parallelism vias inferflow?

  inferflow/inferflow#49 · Filter by author LHQUer opened on Mar 18, 2024
  2

• Support of Whisper

  inferflow/inferflow#41 · Filter by author nemoramo opened on Feb 23, 2024
  2

• Can give a example on huggingface model such as Phi-2,Yi etc.

  inferflow/inferflow#21 · Filter by author Arcmoon-Hu opened on Jan 18, 2024
  4

• Does it support Apple Silicon (M1/M2/M3)?

  inferflow/inferflow#18 · Filter by author zoopigzoo opened on Jan 17, 2024
  1