Issues

• [FEAT] Support OpenVINO NPU device

  type: enhancement / feature
  EmbeddedLLM/embeddedllm#34 · Filter by author szeyu opened on Sep 12, 2024

• [BUG] The health status of chat api server cannot be queried when the chat api server is generating responses.

  type: bug
  EmbeddedLLM/embeddedllm#29 · Filter by author tjtanaa opened on Sep 4, 2024
  1

• [FEAT] Add NPU Engine

  type: enhancement / feature
  EmbeddedLLM/embeddedllm#28 · Filter by author szeyu opened on Sep 3, 2024
  

• [FEAT] Support Whisper Model with IPEX-LLM

  type: enhancement / feature
  EmbeddedLLM/embeddedllm#6 · Filter by author tjtanaa opened on Jul 4, 2024

• [FEAT] Vision Language Model Support with IPEX-LLM

  type: enhancement / feature
  EmbeddedLLM/embeddedllm#5 · Filter by author tjtanaa opened on Jul 4, 2024

• [BUG] Phi-3-Mini fails to execute on long prompts on iGPU with DirectML

  type: bug
  EmbeddedLLM/embeddedllm#1 · Filter by author tjtanaa opened on Jun 18, 2024