-
Notifications
You must be signed in to change notification settings - Fork 7
Open
Description
Hello!
I packed it in Dockerfile and start with my vLLM backend
FROM ubuntu:22.04
RUN apt-get update && \
apt-get install -y default-jdk && \
rm -rf /var/lib/apt/lists/*
COPY ./supercoder /supercoder
WORKDIR /supercoder
ENV \
SUPERCODER_BASE_URL=https://<my_vllm_backend_gateway>/v1 \
SUPERCODER_MODEL=<my-model> \
SUPERCODER_API_KEY=<my-token>
it throws error when I just type - "hello" also something strange going on with CLI
# ./bin/supercoder
??????????????????????????????????????
??????????????????????????????????????
vv0.1.4
Model: vllm-local
Type '/help' for available commands.
> hello
Exception in thread "main" java.lang.NoSuchMethodError: 'java.lang.Object java.util.List.getFirst()'
at com.supercoder.base.BaseChatAgent.chat(Agent.scala:165)
at com.supercoder.ui.TerminalChat$.run(TerminalChat.scala:78)
at com.supercoder.Main$.main(Main.scala:18)
at com.supercoder.Main.main(Main.scala)
root@predator-300-se:/supercoder#
I tried to force wrong model usage and it showed me correct 404 error, but with correct model it fails
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels